Apr 15 20:00:40 devstack cinder-volume[73296]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 20:00:40 devstack cinder-volume[73296]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 20:00:40 devstack cinder-volume[73296]: we strongly recommend against using it for new projects. Apr 15 20:00:40 devstack cinder-volume[73296]: If you are already using Eventlet, we recommend migrating to a different Apr 15 20:00:40 devstack cinder-volume[73296]: framework. For more detail see Apr 15 20:00:40 devstack cinder-volume[73296]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 20:00:40 devstack cinder-volume[73296]: import eventlet # noqa Apr 15 20:00:42 devstack cinder-volume[73296]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73296) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 20:00:42 devstack cinder-volume[73296]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73296) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 20:00:42 devstack cinder-volume[73296]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73296) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 20:00:43 devstack cinder-volume[73296]: INFO dbcounter [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Registered counter for database cinder Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_db.sqlalchemy.engines [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73296) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG dbcounter [-] [73296] Writer thread running {{(pid=73296) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 20:00:43 devstack cinder-volume[73296]: INFO cinder.rpc [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 20:00:43 devstack cinder-volume[73296]: INFO cinder.rpc [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_db.sqlalchemy.engines [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73296) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 20:00:43 devstack cinder-volume[73296]: INFO cinder.volume.manager [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Determined volume DB was empty at startup. Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG cinder.volume.manager [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73296) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 20:00:43 devstack cinder-volume[73296]: INFO cinder.volume.manager [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 15 20:00:43 devstack cinder-volume[73296]: WARNING stevedore.named [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 20:00:43 devstack cinder-volume[73296]: WARNING castellan.key_manager [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 20:00:43 devstack cinder-volume[73296]: WARNING cinder.keymgr.conf_key_mgr [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG cinder.volume.drivers.lvm [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73296) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_concurrency.processutils [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73296) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_concurrency.processutils [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] CMD "cinder-rtstool verify" returned: 0 in 0.216s {{(pid=73296) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_db.sqlalchemy.engines [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73296) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 20:00:43 devstack cinder-volume[73296]: INFO cinder.rpc [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 15 20:00:43 devstack cinder-volume[73296]: INFO cinder.rpc [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 15 20:00:43 devstack cinder-volume[73296]: WARNING stevedore.named [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 20:00:43 devstack cinder-volume[73296]: WARNING castellan.key_manager [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 20:00:43 devstack cinder-volume[73296]: INFO cinder.volume.manager [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_db.sqlalchemy.engines [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73296) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 20:00:43 devstack cinder-volume[73296]: INFO oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Starting 1 workers Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Started child 73402 {{(pid=73296) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Full set of CONF: {{(pid=73296) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] ******************************************************************************** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Configuration options gathered from: {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] ================================================================================ {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] allow_availability_zone_fallback = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73402]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] allow_compression_on_image_upload = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] allowed_direct_url_schemes = [] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] api_rate_limit = True {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] auth_strategy = keystone {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] az_cache_duration = 3600 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_availability_zone = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_host = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_name = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_stats_polling_interval = 60 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backup_api_class = cinder.backup.api.API {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backup_name_template = backup-%s {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backup_use_same_host = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backup_use_temp_snapshot = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] chap_password = **** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] chap_username = {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cinder_internal_tenant_project_id = ee32fb58184f479b8cef64581977bd99 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cinder_internal_tenant_user_id = 47c73541f6924eba8bedfbd260dad63a {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cloned_volume_same_az = True {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cluster = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] compression_format = gzip {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] compute_api_class = cinder.compute.nova.API {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] config_dir = [] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] config_source = [] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] control_exchange = openstack {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] debug = True {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] default_availability_zone = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] default_group_type = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] default_volume_type = lvmdriver-1 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] disk_geometry = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] driver_client_cert = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] driver_client_cert_key = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] driver_data_namespace = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] driver_ssl_cert_path = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] driver_ssl_cert_verify = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] driver_use_ssl = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] enable_force_upload = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] enable_new_services = True {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] enable_unsupported_driver = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] enabled_backends = ['lvmdriver-1'] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] enforce_multipath_for_image_xfer = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] filter_function = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] glance_api_insecure = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] glance_api_servers = ['http://192.168.122.251/image'] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] glance_api_ssl_compression = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] glance_ca_certificates_file = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] glance_catalog_info = image:glance:publicURL {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] glance_certfile = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] glance_keyfile = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] glance_num_retries = 3 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] glance_request_timeout = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] goodness_function = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] graceful_shutdown_timeout = 5 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] group_api_class = cinder.group.api.API {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] host = devstack {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] image_compress_on_upload = True {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] image_conversion_address_space_limit = 1 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] image_conversion_cpu_limit = 60 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] image_conversion_disable = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] image_upload_use_cinder_backend = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] image_upload_use_internal_tenant = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] image_volume_cache_enabled = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] image_volume_cache_max_count = 0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] image_volume_cache_max_size_gb = 0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] init_host_max_objects_retrieval = 0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] instance_format = [instance: %(uuid)s] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] iscsi_target_flags = {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] iscsi_write_cache = on {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] iser_helper = tgtadm {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] iser_ip_address = 192.168.122.251 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73402]: INFO cinder.volume.manager [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] iser_port = 3260 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] log_color = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] log_config_append = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] log_dir = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] log_file = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] log_options = True {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] log_rotate_interval = 1 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] log_rotate_interval_type = days {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] log_rotation_type = none {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] max_age = 0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] max_logfile_count = 30 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] max_logfile_size_mb = 200 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] max_over_subscription_ratio = 20.0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] message_reap_interval = 86400 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] message_ttl = 2592000 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] migration_create_volume_timeout_secs = 300 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] monkey_patch = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] monkey_patch_modules = [] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] my_ip = 192.168.122.251 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] no_snapshot_gb_quota = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] num_iser_scan_tries = 3 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] num_shell_tries = 3 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] num_volume_device_scan_tries = 3 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] nvmeof_conn_info_version = 1 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] nvmet_ns_id = 10 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] nvmet_port_id = 1 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] osapi_max_limit = 1000 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] osapi_volume_ext_list = [] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] osapi_volume_listen_port = 8776 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] osapi_volume_use_ssl = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] osapi_volume_workers = 2 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] per_volume_size_limit = -1 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] periodic_fuzzy_delay = 60 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] periodic_interval = 60 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] public_endpoint = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] publish_errors = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] quota_backup_gigabytes = 1000 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] quota_backups = 10 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] quota_gigabytes = 1000 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] quota_groups = 10 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] quota_snapshots = 10 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] quota_volumes = 10 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] rate_limit_burst = 0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] rate_limit_except_level = CRITICAL {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] rate_limit_interval = 0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] reinit_driver_count = 3 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] replication_device = **** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] report_discard_supported = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] report_interval = 120 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] reservation_clean_interval = 86400 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] reservation_expire = 86400 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] reserved_image_namespaces = [] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] reserved_percentage = 0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] rpc_response_timeout = 120 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] run_external_periodic_tasks = True {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] scst_target_driver = iscsi {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] scst_target_iqn_name = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] service_down_time = 720 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] shell_completion = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] snapshot_name_template = snapshot-%s {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] snapshot_same_host = True {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] split_loggers = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] state_path = /opt/stack/data/cinder {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] storage_availability_zone = nova {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] storage_protocol = iSCSI {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] syslog_log_facility = LOG_USER {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] target_helper = lioadm {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] target_ip_address = 192.168.122.251 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] target_port = 3260 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] target_protocol = iscsi {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] target_secondary_ip_addresses = [] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] trace_flags = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] transport_url = **** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] until_refresh = 0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] use_chap_auth = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] use_default_quota_class = True {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] use_journal = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] use_json = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] use_multipath_for_image_xfer = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] use_stderr = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] use_syslog = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] verify_glance_signatures = enabled {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] volume_api_class = cinder.volume.api.API {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] volume_backend_name = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] volume_clear = zero {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] volume_clear_ionice = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] volume_clear_size = 0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] volume_copy_bps_limit = 0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] volume_dd_blocksize = 1M {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] volume_name_template = volume-%s {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] volume_service_inithost_offload = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] volume_usage_audit_period = month {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] zoning_mode = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_concurrency.disable_process_locking = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.admin_password = **** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.admin_token = **** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.admin_user = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.auth_admin_prefix = {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.auth_port = 35357 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.auth_protocol = https {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.auth_section = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.auth_type = password {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.auth_uri = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.auth_version = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.cache = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.certfile = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.identity_uri = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.include_service_catalog = True {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.insecure = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.interface = public {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.keyfile = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.memcache_password = {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.memcache_username = {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.region_name = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.service_type = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.backend = dogpile.cache.null {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.backend_argument = **** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.backend_expiration_time = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.config_prefix = cache.oslo {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.debug_cache_backend = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.enable_retry_client = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.enable_socket_keepalive = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.enabled = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.enforce_fips_mode = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.expiration_time = 600 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.hashclient_retry_attempts = 2 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.memcache_dead_retry = 300 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.memcache_pool_maxsize = 10 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.memcache_sasl_enabled = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.password = **** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.proxies = [] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.redis_db = 0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.redis_server = localhost:6379 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.retry_attempts = 2 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.retry_delay = 0.0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.socket_keepalive_count = 1 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.socket_keepalive_idle = 1 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.socket_keepalive_interval = 1 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.socket_timeout = 1.0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.tls_allowed_ciphers = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.tls_cafile = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.tls_certfile = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.tls_enabled = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.tls_keyfile = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cache.username = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] coordination.backend_url = **** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] database.asyncio_connection = **** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] database.asyncio_slave_connection = **** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] database.backend = sqlalchemy {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] database.connection = **** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] database.connection_debug = 0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] database.connection_parameters = {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] database.connection_recycle_time = 3600 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] database.connection_trace = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] database.db_inc_retry_interval = True {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] database.db_max_retries = 20 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] database.db_max_retry_interval = 10 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] database.db_retry_interval = 1 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] database.max_overflow = 50 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] database.max_pool_size = 5 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] database.max_retries = 10 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] database.mysql_wsrep_sync_wait = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] database.pool_timeout = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] database.retry_interval = 10 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] database.slave_connection = **** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] database.sqlite_synchronous = True {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] database.synchronous_reader = True {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] database.use_db_reconnect = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] profiler.connection_string = messaging:// {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] profiler.enabled = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] profiler.es_doc_type = notification {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] profiler.es_scroll_size = 10000 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] profiler.es_scroll_time = 2m {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] profiler.filter_error_trace = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] profiler.hmac_keys = **** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] profiler.sentinel_service_name = mymaster {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] profiler.socket_timeout = 0.1 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] profiler.trace_requests = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] profiler.trace_sqlalchemy = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] profiler_jaeger.process_tags = {} {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] profiler_jaeger.service_name_prefix = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] profiler_otlp.service_name_prefix = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_policy.enforce_new_defaults = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: WARNING oslo_config.cfg [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_policy.enforce_scope = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_policy.policy_default_rule = default {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_policy.policy_file = policy.yaml {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] privsep_osbrick.group = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] privsep_osbrick.helper_command = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] privsep_osbrick.user = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cinder_sys_admin.group = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cinder_sys_admin.helper_command = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] cinder_sys_admin.user = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] service_user.auth_section = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] service_user.auth_type = password {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] service_user.cafile = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] service_user.certfile = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] service_user.collect_timing = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] service_user.insecure = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] service_user.keyfile = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] service_user.send_service_user_token = True {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] service_user.split_loggers = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] service_user.timeout = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] glance.auth_section = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] glance.auth_type = password {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] glance.certfile = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack sudo[73406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] glance.collect_timing = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] glance.insecure = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] glance.keyfile = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack sudo[73406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] glance.region_name = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] glance.split_loggers = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] glance.timeout = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.backend_availability_zone = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.chap_password = **** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.chap_username = {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.disk_geometry = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.driver_client_cert = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.driver_client_cert_key = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.driver_data_namespace = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.driver_use_ssl = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.extra_capabilities = {} {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.filter_function = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.goodness_function = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.iscsi_target_flags = {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.iscsi_write_cache = on {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.iser_helper = tgtadm {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.iser_port = 3260 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.lvm_mirrors = 0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.lvm_share_target = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.lvm_type = auto {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.num_shell_tries = 3 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.replication_device = **** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.report_discard_supported = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.reserved_percentage = 0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.target_helper = tgtadm {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.target_port = 3260 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.target_protocol = iscsi {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.trace_flags = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.unique_fqdn_network = True {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.use_chap_auth = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.volume_backend_name = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.volume_clear = zero {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.volume_clear_ionice = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.volume_clear_size = 0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.volume_group = cinder-volumes {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_reports.file_event_handler = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_reports.log_dir = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.backend_availability_zone = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.backend_host = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.chap_password = **** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.chap_username = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.chiscsi_conf = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.disk_geometry = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.driver_client_cert = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.driver_data_namespace = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.driver_use_ssl = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.extra_capabilities = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.filter_function = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.goodness_function = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.iser_helper = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.iser_ip_address = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.iser_port = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.iser_target_prefix = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.lvm_conf_file = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.lvm_mirrors = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.lvm_share_target = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.lvm_type = auto {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.num_shell_tries = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.nvmet_port_id = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.replication_device = **** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.report_discard_supported = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.reserved_percentage = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.scst_target_driver = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.storage_protocol = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.target_helper = lioadm {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.target_ip_address = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.target_port = 3260 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.target_protocol = iscsi {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.trace_flags = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.use_chap_auth = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.volume_clear = zero {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.volume_clear_size = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] lvmdriver-1.volumes_dir = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.ssl = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_notifications.driver = [] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_notifications.retry = -1 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] key_manager.fixed_key = **** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican.barbican_api_version = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican.barbican_endpoint = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican.barbican_endpoint_type = public {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican.barbican_region_name = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican.cafile = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican.certfile = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican.collect_timing = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican.insecure = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican.keyfile = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican.number_of_retries = 60 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican.retry_delay = 1 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican.send_service_user_token = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican.split_loggers = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican.timeout = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican.verify_ssl = True {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican.verify_ssl_path = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican_service_user.auth_section = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican_service_user.auth_type = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican_service_user.cafile = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican_service_user.certfile = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican_service_user.collect_timing = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican_service_user.insecure = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican_service_user.keyfile = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican_service_user.split_loggers = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] barbican_service_user.timeout = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] vault.approle_role_id = **** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] vault.approle_secret_id = **** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] vault.kv_mountpoint = secret {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] vault.kv_path = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] vault.kv_version = 2 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] vault.namespace = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] vault.root_token_id = **** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] vault.ssl_ca_crt_file = None {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] vault.timeout = 60.0 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] vault.use_ssl = False {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:00:43 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] ******************************************************************************** {{(pid=73296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 20:00:44 devstack sudo[73406]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:44 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.511s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:44 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:44 devstack sudo[73412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 20:00:44 devstack sudo[73412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:44 devstack sudo[73412]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:44 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.523s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:44 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 20:00:44 devstack cinder-volume[73402]: INFO cinder.brick.local_dev.lvm [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 15 20:00:44 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:44 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.011s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:44 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:44 devstack sudo[73653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 20:00:44 devstack sudo[73653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:45 devstack sudo[73653]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:45 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.498s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:45 devstack cinder-volume[73402]: DEBUG cinder.brick.local_dev.lvm [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73402) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 15 20:00:45 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:45 devstack sudo[73898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 20:00:45 devstack sudo[73898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:46 devstack sudo[73898]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:46 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.981s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:46 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:46 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:46 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:46 devstack sudo[74073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 20:00:46 devstack sudo[74073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:46 devstack sudo[74073]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:46 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.461s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:46 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:46 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:46 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:46 devstack sudo[74102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 15 20:00:46 devstack sudo[74102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:47 devstack sudo[74102]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:47 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.522s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:47 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:47 devstack sudo[74108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 20:00:47 devstack sudo[74108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:47 devstack sudo[74108]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:47 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.527s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:47 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:47 devstack sudo[74113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 20:00:47 devstack sudo[74113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:48 devstack sudo[74113]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:48 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.559s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:48 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:48 devstack sudo[74118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 20:00:48 devstack sudo[74118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:49 devstack sudo[74118]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:49 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.533s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:49 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:49 devstack sudo[74121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 20:00:49 devstack sudo[74121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:49 devstack sudo[74121]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:49 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.609s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:49 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:49 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:49 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:49 devstack sudo[74134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 20:00:49 devstack sudo[74134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:50 devstack sudo[74134]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:50 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.432s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:50 devstack cinder-volume[73402]: INFO cinder.volume.drivers.lvm [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 15 20:00:50 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:50 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:50 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:50 devstack sudo[74247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 20:00:50 devstack sudo[74247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:50 devstack sudo[74247]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:50 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.433s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:50 devstack cinder-volume[73402]: DEBUG cinder.volume.drivers.lvm [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Updating volume stats {{(pid=73402) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 20:00:50 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:50 devstack sudo[74367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 20:00:50 devstack sudo[74367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:50 devstack sudo[74367]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:51 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:51 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:51 devstack sudo[74391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 20:00:51 devstack sudo[74391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:51 devstack sudo[74391]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:51 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.406s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:51 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:51 devstack sudo[74395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 20:00:51 devstack sudo[74395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:51 devstack sudo[74395]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:51 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.423s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:51 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:51 devstack sudo[74398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 20:00:51 devstack sudo[74398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:52 devstack sudo[74398]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:52 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.415s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:52 devstack cinder-volume[73402]: INFO cinder.volume.driver [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Driver hasn't implemented _init_vendor_properties() Apr 15 20:00:52 devstack cinder-volume[73402]: DEBUG cinder.volume.driver [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73402) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 20:00:52 devstack cinder-volume[73402]: DEBUG oslo_db.sqlalchemy.engines [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73402) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 20:00:52 devstack cinder-volume[73402]: DEBUG dbcounter [-] [73402] Writer thread running {{(pid=73402) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 20:00:52 devstack cinder-volume[73402]: DEBUG cinder.db.sqlalchemy.api [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Building query based on filter {{(pid=73402) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 20:00:52 devstack cinder-volume[73402]: DEBUG cinder.image.image_utils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73402) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 20:00:52 devstack cinder-volume[73402]: INFO cinder.keymgr.migration [None req-e4e1c543-a487-4c70-8090-b690cd9b508f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 20:00:52 devstack cinder-volume[73402]: DEBUG cinder.volume.drivers.lvm [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Updating volume stats {{(pid=73402) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 20:00:52 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:52 devstack sudo[74404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 20:00:52 devstack sudo[74404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:52 devstack sudo[74404]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:52 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.531s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:52 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:52 devstack sudo[74407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 20:00:52 devstack sudo[74407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:53 devstack sudo[74407]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:53 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.477s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:53 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:53 devstack sudo[74414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 20:00:53 devstack sudo[74414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:53 devstack cinder-volume[73296]: DEBUG dbcounter [-] [73296] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73296) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:00:53 devstack sudo[74414]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:53 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.481s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:53 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:53 devstack sudo[74420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 20:00:53 devstack sudo[74420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:54 devstack sudo[74420]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:54 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:54 devstack cinder-volume[73402]: DEBUG cinder.manager [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Notifying Schedulers of capabilities ... {{(pid=73402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:00:54 devstack cinder-volume[73402]: INFO cinder.volume.manager [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Driver initialization completed successfully. Apr 15 20:00:54 devstack cinder-volume[73402]: INFO cinder.manager [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Initiating service 2 cleanup Apr 15 20:00:54 devstack cinder-volume[73402]: INFO cinder.manager [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Service 2 cleanup completed. Apr 15 20:00:54 devstack cinder-volume[73402]: DEBUG cinder.service [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Creating RPC server for service cinder-volume {{(pid=73402) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 20:00:54 devstack cinder-volume[73402]: DEBUG cinder.service [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73402) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 20:00:54 devstack cinder-volume[73402]: INFO cinder.volume.manager [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 15 20:00:54 devstack cinder-volume[73402]: DEBUG cinder.volume.drivers.lvm [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Updating volume stats {{(pid=73402) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 20:00:54 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:54 devstack sudo[74425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 20:00:54 devstack sudo[74425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:54 devstack sudo[74425]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:54 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.485s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:54 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:54 devstack sudo[74482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 20:00:54 devstack sudo[74482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:55 devstack sudo[74482]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:55 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:55 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:55 devstack sudo[74488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 20:00:55 devstack sudo[74488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:55 devstack sudo[74488]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:55 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.443s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:55 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:00:55 devstack sudo[74492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 20:00:55 devstack sudo[74492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:00:56 devstack sudo[74492]: pam_unix(sudo:session): session closed for user root Apr 15 20:00:56 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:00:56 devstack cinder-volume[73402]: INFO cinder.volume.manager [None req-5958ed73-ce80-4edc-94e8-ccc58fe95af5 None None] Driver post RPC initialization completed successfully. Apr 15 20:01:06 devstack cinder-volume[73402]: DEBUG dbcounter [-] [73402] Writing DB stats cinder:SELECT=4 {{(pid=73402) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:01:06 devstack cinder-volume[73402]: DEBUG dbcounter [-] [73402] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=73402) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:02:15 devstack cinder-volume[73402]: DEBUG oslo_service.periodic_task [None req-4f0060c4-4041-4b3e-8c22-741cb0e971e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73402) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 20:02:15 devstack cinder-volume[73402]: DEBUG cinder.volume.drivers.lvm [None req-4f0060c4-4041-4b3e-8c22-741cb0e971e6 None None] Updating volume stats {{(pid=73402) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 20:02:15 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-4f0060c4-4041-4b3e-8c22-741cb0e971e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:02:15 devstack sudo[79403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 20:02:15 devstack sudo[79403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:02:15 devstack sudo[79403]: pam_unix(sudo:session): session closed for user root Apr 15 20:02:15 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-4f0060c4-4041-4b3e-8c22-741cb0e971e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:02:15 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-4f0060c4-4041-4b3e-8c22-741cb0e971e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:02:15 devstack sudo[79411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 20:02:15 devstack sudo[79411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:02:16 devstack sudo[79411]: pam_unix(sudo:session): session closed for user root Apr 15 20:02:16 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-4f0060c4-4041-4b3e-8c22-741cb0e971e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:02:16 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-4f0060c4-4041-4b3e-8c22-741cb0e971e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:02:16 devstack sudo[79422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 20:02:16 devstack sudo[79422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:02:16 devstack sudo[79422]: pam_unix(sudo:session): session closed for user root Apr 15 20:02:16 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-4f0060c4-4041-4b3e-8c22-741cb0e971e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.456s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:02:16 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-4f0060c4-4041-4b3e-8c22-741cb0e971e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:02:16 devstack sudo[79432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 20:02:16 devstack sudo[79432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:02:17 devstack sudo[79432]: pam_unix(sudo:session): session closed for user root Apr 15 20:02:17 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-4f0060c4-4041-4b3e-8c22-741cb0e971e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:02:17 devstack cinder-volume[73402]: DEBUG cinder.manager [None req-4f0060c4-4041-4b3e-8c22-741cb0e971e6 None None] Notifying Schedulers of capabilities ... {{(pid=73402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:03:06 devstack cinder-volume[73402]: DEBUG dbcounter [-] [73402] Writing DB stats cinder:SELECT=1 {{(pid=73402) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:03:06 devstack cinder-volume[73402]: DEBUG dbcounter [-] [73402] Writing DB stats cinder:UPDATE=1 {{(pid=73402) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:03:15 devstack cinder-volume[73402]: DEBUG oslo_service.periodic_task [None req-4f0060c4-4041-4b3e-8c22-741cb0e971e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73402) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 20:03:15 devstack cinder-volume[73402]: DEBUG cinder.volume.drivers.lvm [None req-4f0060c4-4041-4b3e-8c22-741cb0e971e6 None None] Updating volume stats {{(pid=73402) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 20:03:15 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-4f0060c4-4041-4b3e-8c22-741cb0e971e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:03:15 devstack sudo[81306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 20:03:15 devstack sudo[81306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:03:15 devstack sudo[81306]: pam_unix(sudo:session): session closed for user root Apr 15 20:03:15 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-4f0060c4-4041-4b3e-8c22-741cb0e971e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:03:15 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-4f0060c4-4041-4b3e-8c22-741cb0e971e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:03:15 devstack sudo[81337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 20:03:15 devstack sudo[81337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:03:16 devstack sudo[81337]: pam_unix(sudo:session): session closed for user root Apr 15 20:03:16 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-4f0060c4-4041-4b3e-8c22-741cb0e971e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.416s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:03:16 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-4f0060c4-4041-4b3e-8c22-741cb0e971e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:03:16 devstack sudo[81353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 20:03:16 devstack sudo[81353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:03:16 devstack sudo[81353]: pam_unix(sudo:session): session closed for user root Apr 15 20:03:16 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-4f0060c4-4041-4b3e-8c22-741cb0e971e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.432s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:03:16 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-4f0060c4-4041-4b3e-8c22-741cb0e971e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:03:16 devstack sudo[81360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 20:03:16 devstack sudo[81360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:03:16 devstack sudo[81360]: pam_unix(sudo:session): session closed for user root Apr 15 20:03:16 devstack cinder-volume[73402]: DEBUG oslo_concurrency.processutils [None req-4f0060c4-4041-4b3e-8c22-741cb0e971e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=73402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:03:16 devstack cinder-volume[73402]: DEBUG cinder.manager [None req-4f0060c4-4041-4b3e-8c22-741cb0e971e6 None None] Notifying Schedulers of capabilities ... {{(pid=73402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:04:05 devstack cinder-volume[73296]: INFO oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Caught SIGTERM, stopping children Apr 15 20:04:05 devstack cinder-volume[73296]: DEBUG oslo_concurrency.lockutils [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Acquiring lock "singleton_lock" {{(pid=73296) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 20:04:05 devstack cinder-volume[73296]: DEBUG oslo_concurrency.lockutils [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Acquired lock "singleton_lock" {{(pid=73296) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 20:04:05 devstack cinder-volume[73296]: DEBUG oslo_concurrency.lockutils [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Releasing lock "singleton_lock" {{(pid=73296) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 20:04:05 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Stop services. {{(pid=73296) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 15 20:04:05 devstack cinder-volume[73296]: DEBUG oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Killing children. {{(pid=73296) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 15 20:04:05 devstack cinder-volume[73296]: INFO oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Waiting on 1 children to exit Apr 15 20:04:09 devstack cinder-volume[73402]: DEBUG oslo_concurrency.lockutils [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Acquiring lock "singleton_lock" {{(pid=73402) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 20:04:09 devstack cinder-volume[73402]: DEBUG oslo_concurrency.lockutils [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Acquired lock "singleton_lock" {{(pid=73402) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 20:04:09 devstack cinder-volume[73402]: DEBUG oslo_concurrency.lockutils [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Releasing lock "singleton_lock" {{(pid=73402) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 20:04:09 devstack cinder-volume[73402]: WARNING amqp [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 20:04:09 devstack cinder-volume[73402]: WARNING amqp [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 20:04:09 devstack cinder-volume[73296]: INFO oslo_service.backend._eventlet.service [None req-f59b5c50-d965-4bfb-9823-c91a306bafd0 None None] Child 73402 exited with status 0 Apr 15 20:04:09 devstack cinder-volume[82487]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 20:04:09 devstack cinder-volume[82487]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 20:04:09 devstack cinder-volume[82487]: we strongly recommend against using it for new projects. Apr 15 20:04:09 devstack cinder-volume[82487]: If you are already using Eventlet, we recommend migrating to a different Apr 15 20:04:09 devstack cinder-volume[82487]: framework. For more detail see Apr 15 20:04:09 devstack cinder-volume[82487]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 20:04:09 devstack cinder-volume[82487]: import eventlet # noqa Apr 15 20:04:11 devstack cinder-volume[82487]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 20:04:11 devstack cinder-volume[82487]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 20:04:11 devstack cinder-volume[82487]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 20:04:12 devstack cinder-volume[82487]: INFO dbcounter [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Registered counter for database cinder Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_db.sqlalchemy.engines [None req-6aef656a-3107-4507-a29c-3157a31398af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82487) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG dbcounter [-] [82487] Writer thread running {{(pid=82487) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 20:04:12 devstack cinder-volume[82487]: INFO cinder.rpc [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 20:04:12 devstack cinder-volume[82487]: INFO cinder.rpc [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_db.sqlalchemy.engines [None req-6aef656a-3107-4507-a29c-3157a31398af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82487) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 20:04:12 devstack cinder-volume[82487]: INFO cinder.volume.manager [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Determined volume DB was empty at startup. Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG cinder.volume.manager [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82487) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 20:04:12 devstack cinder-volume[82487]: INFO cinder.volume.manager [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 15 20:04:12 devstack cinder-volume[82487]: WARNING stevedore.named [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 20:04:12 devstack cinder-volume[82487]: WARNING castellan.key_manager [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 20:04:12 devstack cinder-volume[82487]: WARNING cinder.keymgr.conf_key_mgr [None req-6aef656a-3107-4507-a29c-3157a31398af None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 20:04:12 devstack cinder-volume[82487]: INFO cinder.volume.manager [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_db.sqlalchemy.engines [None req-6aef656a-3107-4507-a29c-3157a31398af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82487) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 20:04:12 devstack cinder-volume[82487]: INFO oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Starting 1 workers Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Started child 82603 {{(pid=82487) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Full set of CONF: {{(pid=82487) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] ******************************************************************************** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Configuration options gathered from: {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] ================================================================================ {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] allow_availability_zone_fallback = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] allow_compression_on_image_upload = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] allowed_direct_url_schemes = [] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] api_rate_limit = True {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] auth_strategy = keystone {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_availability_zone = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_host = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_name = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_stats_polling_interval = 60 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backup_api_class = cinder.backup.api.API {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backup_name_template = backup-%s {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backup_use_same_host = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backup_use_temp_snapshot = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] chap_password = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] chap_username = {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cinder_internal_tenant_project_id = ee32fb58184f479b8cef64581977bd99 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cinder_internal_tenant_user_id = 47c73541f6924eba8bedfbd260dad63a {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cluster = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] compression_format = gzip {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] compute_api_class = cinder.compute.nova.API {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] config_dir = [] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] config_source = [] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] control_exchange = openstack {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] debug = True {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] default_availability_zone = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] default_group_type = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] default_volume_type = QuobyteHD {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] disk_geometry = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] driver_client_cert = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] driver_client_cert_key = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] driver_data_namespace = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] driver_ssl_cert_path = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] driver_ssl_cert_verify = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] driver_use_ssl = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] enable_new_services = True {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] enable_unsupported_driver = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] enabled_backends = ['QuobyteHD'] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82603]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] enforce_multipath_for_image_xfer = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] filter_function = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] glance_api_insecure = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] glance_api_servers = ['http://192.168.122.251/image'] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] glance_api_ssl_compression = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] glance_ca_certificates_file = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] glance_catalog_info = image:glance:publicURL {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] glance_certfile = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] glance_keyfile = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] glance_num_retries = 3 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] glance_request_timeout = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] goodness_function = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] graceful_shutdown_timeout = 5 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] group_api_class = cinder.group.api.API {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] host = devstack {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] image_compress_on_upload = True {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] image_conversion_address_space_limit = 1 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] image_conversion_cpu_limit = 60 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] image_conversion_disable = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] image_upload_use_cinder_backend = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] image_upload_use_internal_tenant = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] image_volume_cache_enabled = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] image_volume_cache_max_count = 0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] image_volume_cache_max_size_gb = 0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] init_host_max_objects_retrieval = 0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] instance_format = [instance: %(uuid)s] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] iscsi_target_flags = {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] iscsi_write_cache = on {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] iser_helper = tgtadm {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] iser_ip_address = 192.168.122.251 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] iser_port = 3260 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] log_color = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] log_config_append = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] log_dir = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] log_file = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] log_options = True {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] log_rotate_interval = 1 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] log_rotate_interval_type = days {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] log_rotation_type = none {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] max_age = 0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] max_logfile_count = 30 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] max_logfile_size_mb = 200 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] max_over_subscription_ratio = 20.0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] message_reap_interval = 86400 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] message_ttl = 2592000 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] migration_create_volume_timeout_secs = 300 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] monkey_patch = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] monkey_patch_modules = [] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] my_ip = 192.168.122.251 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] no_snapshot_gb_quota = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] num_iser_scan_tries = 3 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] num_shell_tries = 3 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] num_volume_device_scan_tries = 3 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] nvmeof_conn_info_version = 1 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] nvmet_ns_id = 10 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] nvmet_port_id = 1 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] osapi_max_limit = 1000 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] osapi_volume_ext_list = [] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] osapi_volume_listen = 0.0.0.0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82603]: INFO cinder.volume.manager [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Starting volume driver QuobyteDriver (1.1.14) Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] osapi_volume_listen_port = 8776 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] osapi_volume_use_ssl = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] osapi_volume_workers = 2 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] per_volume_size_limit = -1 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] periodic_fuzzy_delay = 60 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] periodic_interval = 60 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82603]: DEBUG cinder.volume.drivers.remotefs [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82603) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] project_id_regex = [0-9a-f\-]+ {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] public_endpoint = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] publish_errors = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] quota_backup_gigabytes = 1000 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] quota_backups = 10 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] quota_gigabytes = 1000 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] quota_groups = 10 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] quota_snapshots = 10 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] quota_volumes = 10 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] rate_limit_burst = 0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] rate_limit_except_level = CRITICAL {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] rate_limit_interval = 0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] reinit_driver_count = 3 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] replication_device = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] report_discard_supported = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] report_interval = 120 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] reservation_clean_interval = 86400 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] reservation_expire = 86400 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] reserved_image_namespaces = [] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] reserved_percentage = 0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] rpc_response_timeout = 120 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] run_external_periodic_tasks = True {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] scst_target_driver = iscsi {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] scst_target_iqn_name = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] service_down_time = 720 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] shell_completion = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] snapshot_name_template = snapshot-%s {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] split_loggers = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] state_path = /opt/stack/data/cinder {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] storage_availability_zone = nova {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] storage_protocol = iSCSI {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] syslog_log_facility = LOG_USER {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] target_helper = lioadm {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] target_ip_address = 192.168.122.251 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] target_port = 3260 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] target_protocol = iscsi {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] target_secondary_ip_addresses = [] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] trace_flags = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] transfer_api_class = cinder.transfer.api.API {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] transport_url = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] until_refresh = 0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] use_chap_auth = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] use_default_quota_class = True {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] use_journal = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] use_json = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] use_multipath_for_image_xfer = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] use_stderr = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] use_syslog = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] verify_glance_signatures = enabled {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] volume_api_class = cinder.volume.api.API {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] volume_backend_name = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] volume_clear = zero {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] volume_clear_ionice = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] volume_clear_size = 0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] volume_copy_bps_limit = 0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] volume_dd_blocksize = 1M {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] volume_name_template = volume-%s {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] volume_service_inithost_offload = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] volume_usage_audit_period = month {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] zoning_mode = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_concurrency.disable_process_locking = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.admin_password = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.admin_token = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.admin_user = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.auth_admin_prefix = {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.auth_port = 35357 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.auth_protocol = https {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.auth_section = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.auth_type = password {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.auth_uri = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.auth_version = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.cache = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.certfile = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.delay_auth_decision = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.http_connect_timeout = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.identity_uri = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.include_service_catalog = True {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.insecure = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.interface = public {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.keyfile = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.memcache_password = {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.memcache_username = {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.region_name = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.service_token_roles_required = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.service_type = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.token_cache_time = 300 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.backend = dogpile.cache.null {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.backend_argument = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.backend_expiration_time = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.config_prefix = cache.oslo {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.debug_cache_backend = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.enable_retry_client = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.enable_socket_keepalive = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.enabled = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.enforce_fips_mode = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.expiration_time = 600 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.hashclient_retry_attempts = 2 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.memcache_dead_retry = 300 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.memcache_pool_maxsize = 10 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.memcache_sasl_enabled = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.password = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.proxies = [] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.redis_db = 0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.redis_sentinel_service_name = mymaster {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.redis_server = localhost:6379 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.retry_attempts = 2 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.retry_delay = 0.0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.socket_keepalive_count = 1 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.socket_keepalive_idle = 1 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.socket_keepalive_interval = 1 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.socket_timeout = 1.0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.tls_allowed_ciphers = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.tls_cafile = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.tls_certfile = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.tls_enabled = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.tls_keyfile = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cache.username = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] coordination.backend_url = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] database.asyncio_connection = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] database.asyncio_slave_connection = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] database.backend = sqlalchemy {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] database.connection = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] database.connection_debug = 0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] database.connection_parameters = {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] database.connection_recycle_time = 3600 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] database.connection_trace = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] database.db_inc_retry_interval = True {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] database.db_max_retries = 20 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] database.db_max_retry_interval = 10 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] database.db_retry_interval = 1 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] database.max_overflow = 50 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] database.max_pool_size = 5 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] database.max_retries = 10 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] database.mysql_wsrep_sync_wait = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] database.pool_timeout = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] database.retry_interval = 10 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] database.slave_connection = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] database.sqlite_synchronous = True {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] database.synchronous_reader = True {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] database.use_db_reconnect = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] profiler.connection_string = messaging:// {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] profiler.enabled = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] profiler.es_doc_type = notification {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] profiler.es_scroll_size = 10000 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] profiler.es_scroll_time = 2m {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] profiler.filter_error_trace = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] profiler.hmac_keys = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] profiler.sentinel_service_name = mymaster {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] profiler.socket_timeout = 0.1 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] profiler.trace_requests = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] profiler.trace_sqlalchemy = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] profiler_jaeger.process_tags = {} {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] profiler_jaeger.service_name_prefix = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] profiler_otlp.service_name_prefix = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_policy.enforce_new_defaults = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: WARNING oslo_config.cfg [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_policy.enforce_scope = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_policy.policy_default_rule = default {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_policy.policy_file = policy.yaml {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_policy.remote_timeout = 60.0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] privsep_osbrick.group = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] privsep_osbrick.helper_command = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] privsep_osbrick.user = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cinder_sys_admin.group = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cinder_sys_admin.helper_command = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] cinder_sys_admin.user = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] service_user.auth_section = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] service_user.auth_type = password {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] service_user.cafile = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] service_user.certfile = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] service_user.collect_timing = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] service_user.insecure = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] service_user.keyfile = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] service_user.send_service_user_token = True {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] service_user.split_loggers = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] service_user.timeout = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] glance.auth_section = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] glance.auth_type = password {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] glance.certfile = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] glance.collect_timing = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] glance.insecure = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] glance.keyfile = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] glance.region_name = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] glance.split_loggers = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] glance.timeout = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.backend_availability_zone = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.chap_password = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.chap_username = {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.disk_geometry = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.driver_client_cert = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.driver_client_cert_key = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.driver_data_namespace = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.driver_use_ssl = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.enable_unsupported_driver = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.extra_capabilities = {} {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.filter_function = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.goodness_function = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.iscsi_target_flags = {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.iscsi_write_cache = on {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.iser_helper = tgtadm {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.iser_port = 3260 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.nas_host = {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.nas_login = admin {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.nas_mount_options = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.nas_password = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.nas_private_key = {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.nas_share_path = {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.nas_ssh_port = 22 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.num_shell_tries = 3 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.nvmet_port_id = 1 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.quobyte_client_cfg = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.quobyte_volume_url = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.replication_device = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.report_discard_supported = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.reserved_percentage = 0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.scst_target_driver = iscsi {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.scst_target_iqn_name = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.storage_protocol = iSCSI {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.target_helper = tgtadm {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.target_port = 3260 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.target_protocol = iscsi {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.trace_flags = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.unique_fqdn_network = True {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.use_chap_auth = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.volume_backend_name = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.volume_clear = zero {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.volume_clear_ionice = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.volume_clear_size = 0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_reports.file_event_handler = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_reports.log_dir = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.backend_availability_zone = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.backend_host = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.chap_password = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.chap_username = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.chiscsi_conf = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.disk_geometry = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.driver_client_cert = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.driver_client_cert_key = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.driver_data_namespace = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.driver_use_ssl = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.extra_capabilities = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.filter_function = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.goodness_function = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.iscsi_target_flags = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.iscsi_write_cache = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.iser_helper = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.iser_ip_address = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.iser_port = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.iser_target_prefix = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.nas_host = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.nas_login = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.nas_mount_options = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.nas_password = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.nas_private_key = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.nas_share_path = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.nas_ssh_port = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.num_shell_tries = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.nvmet_ns_id = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.nvmet_port_id = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.replication_device = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.report_discard_supported = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.reserved_percentage = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.scst_target_driver = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.storage_protocol = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.target_helper = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.target_ip_address = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.target_port = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.target_prefix = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.target_protocol = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.trace_flags = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.unique_fqdn_network = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.use_chap_auth = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.volume_clear = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.volume_clear_ionice = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.volume_clear_size = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] QuobyteHD.volumes_dir = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.ssl = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.ssl_version = {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_notifications.driver = [] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_notifications.retry = -1 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] oslo_messaging_notifications.transport_url = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] key_manager.fixed_key = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican.barbican_api_version = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican.barbican_endpoint = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican.barbican_endpoint_type = public {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican.barbican_region_name = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican.cafile = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican.certfile = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican.collect_timing = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican.insecure = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican.keyfile = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican.number_of_retries = 60 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican.retry_delay = 1 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican.send_service_user_token = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican.split_loggers = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican.timeout = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican.verify_ssl = True {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican.verify_ssl_path = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican_service_user.auth_section = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican_service_user.auth_type = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican_service_user.cafile = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican_service_user.certfile = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican_service_user.collect_timing = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican_service_user.insecure = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican_service_user.keyfile = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican_service_user.split_loggers = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] barbican_service_user.timeout = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] vault.approle_role_id = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] vault.approle_secret_id = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] vault.kv_mountpoint = secret {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] vault.kv_path = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] vault.kv_version = 2 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] vault.namespace = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] vault.root_token_id = **** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] vault.ssl_ca_crt_file = None {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] vault.timeout = 60.0 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] vault.use_ssl = False {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:12 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] ******************************************************************************** {{(pid=82487) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 20:04:12 devstack cinder-volume[82603]: DEBUG cinder.volume.drivers.quobyte [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82603) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 15 20:04:12 devstack cinder-volume[82603]: WARNING cinder.volume.drivers.quobyte [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 15 20:04:12 devstack cinder-volume[82603]: WARNING cinder.volume.drivers.quobyte [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 15 20:04:12 devstack cinder-volume[82603]: DEBUG oslo_concurrency.processutils [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Running cmd (subprocess): mount.quobyte {{(pid=82603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:04:12 devstack quobyte-client[82607]: Reading configuration file: /etc/quobyte/client.cfg Apr 15 20:04:12 devstack quobyte-client[82607]: Invalid parameters found, error: missing mount point. Apr 15 20:04:12 devstack quobyte-client[82607]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 15 20:04:12 devstack quobyte-client[82607]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 15 20:04:12 devstack cinder-volume[82603]: DEBUG oslo_concurrency.processutils [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] CMD "mount.quobyte" returned: 1 in 0.055s {{(pid=82603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:04:12 devstack cinder-volume[82603]: DEBUG oslo_concurrency.lockutils [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82603) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:04:12 devstack cinder-volume[82603]: DEBUG oslo_concurrency.lockutils [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82603) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:04:12 devstack cinder-volume[82603]: DEBUG cinder.volume.drivers.quobyte [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:04:12 devstack cinder-volume[82603]: INFO cinder.volume.drivers.quobyte [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab ... Apr 15 20:04:12 devstack cinder-volume[82603]: DEBUG oslo_concurrency.processutils [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df -c /etc/quobyte/client-cinder.cfg {{(pid=82603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:04:12 devstack sudo[82608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df -c /etc/quobyte/client-cinder.cfg Apr 15 20:04:12 devstack sudo[82608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:04:13 devstack sudo[82608]: pam_unix(sudo:session): session closed for user root Apr 15 20:04:13 devstack cinder-volume[82603]: DEBUG oslo_concurrency.processutils [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.466s {{(pid=82603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:04:13 devstack cinder-volume[82603]: INFO cinder.volume.drivers.quobyte [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab succeeded Apr 15 20:04:13 devstack cinder-volume[82603]: DEBUG cinder.volume.drivers.quobyte [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:04:13 devstack cinder-volume[82603]: DEBUG oslo_concurrency.lockutils [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.473s {{(pid=82603) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:04:13 devstack cinder-volume[82603]: DEBUG oslo_concurrency.processutils [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:04:13 devstack sudo[82677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:04:13 devstack sudo[82677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:04:13 devstack sudo[82677]: pam_unix(sudo:session): session closed for user root Apr 15 20:04:13 devstack cinder-volume[82603]: DEBUG oslo_concurrency.processutils [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.378s {{(pid=82603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:04:13 devstack cinder-volume[82603]: INFO cinder.volume.driver [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Driver hasn't implemented _init_vendor_properties() Apr 15 20:04:13 devstack cinder-volume[82603]: DEBUG cinder.volume.driver [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7328071594238, 'free_capacity_gb': 1775.7328071594238, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82603) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 20:04:13 devstack cinder-volume[82603]: DEBUG oslo_db.sqlalchemy.engines [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82603) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 20:04:13 devstack cinder-volume[82603]: DEBUG dbcounter [-] [82603] Writer thread running {{(pid=82603) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 20:04:13 devstack cinder-volume[82603]: DEBUG cinder.db.sqlalchemy.api [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Building query based on filter {{(pid=82603) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 20:04:13 devstack cinder-volume[82603]: DEBUG cinder.image.image_utils [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82603) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 20:04:13 devstack cinder-volume[82603]: INFO cinder.keymgr.migration [None req-d8029d5c-5ecb-44ac-9fab-bd623484a220 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 20:04:13 devstack cinder-volume[82603]: DEBUG oslo_concurrency.lockutils [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82603) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:04:13 devstack cinder-volume[82603]: DEBUG oslo_concurrency.lockutils [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82603) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:04:13 devstack cinder-volume[82603]: DEBUG cinder.volume.drivers.quobyte [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:04:13 devstack cinder-volume[82603]: DEBUG cinder.volume.drivers.quobyte [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:04:13 devstack cinder-volume[82603]: DEBUG oslo_concurrency.lockutils [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82603) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:04:13 devstack cinder-volume[82603]: DEBUG oslo_concurrency.processutils [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:04:13 devstack sudo[82680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:04:13 devstack sudo[82680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:04:14 devstack sudo[82680]: pam_unix(sudo:session): session closed for user root Apr 15 20:04:14 devstack cinder-volume[82603]: DEBUG oslo_concurrency.processutils [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.455s {{(pid=82603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:04:14 devstack cinder-volume[82603]: DEBUG cinder.manager [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Notifying Schedulers of capabilities ... {{(pid=82603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:04:14 devstack cinder-volume[82603]: INFO cinder.volume.manager [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Driver initialization completed successfully. Apr 15 20:04:14 devstack cinder-volume[82603]: INFO cinder.manager [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Initiating service 3 cleanup Apr 15 20:04:14 devstack cinder-volume[82603]: INFO cinder.manager [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Service 3 cleanup completed. Apr 15 20:04:14 devstack cinder-volume[82603]: DEBUG cinder.service [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Creating RPC server for service cinder-volume {{(pid=82603) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 20:04:14 devstack cinder-volume[82603]: DEBUG cinder.service [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82603) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 20:04:14 devstack cinder-volume[82603]: INFO cinder.volume.manager [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 15 20:04:14 devstack cinder-volume[82603]: DEBUG oslo_concurrency.lockutils [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82603) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:04:14 devstack cinder-volume[82603]: DEBUG oslo_concurrency.lockutils [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82603) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:04:14 devstack cinder-volume[82603]: DEBUG cinder.volume.drivers.quobyte [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:04:14 devstack cinder-volume[82603]: DEBUG cinder.volume.drivers.quobyte [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:04:14 devstack cinder-volume[82603]: DEBUG oslo_concurrency.lockutils [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82603) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:04:14 devstack cinder-volume[82603]: DEBUG oslo_concurrency.processutils [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:04:14 devstack sudo[82685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:04:14 devstack sudo[82685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:04:14 devstack sudo[82685]: pam_unix(sudo:session): session closed for user root Apr 15 20:04:14 devstack cinder-volume[82603]: DEBUG oslo_concurrency.processutils [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.417s {{(pid=82603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:04:14 devstack cinder-volume[82603]: INFO cinder.volume.manager [None req-2a294e80-e5b7-4ebf-897c-c7d3ff37937b None None] Driver post RPC initialization completed successfully. Apr 15 20:04:17 devstack cinder-volume[82603]: DEBUG oslo_concurrency.lockutils [None req-a0ebe97d-9a8b-4545-bc11-91adf052257e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82603) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:04:17 devstack cinder-volume[82603]: DEBUG oslo_concurrency.lockutils [None req-a0ebe97d-9a8b-4545-bc11-91adf052257e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82603) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:04:17 devstack cinder-volume[82603]: DEBUG cinder.volume.drivers.quobyte [None req-a0ebe97d-9a8b-4545-bc11-91adf052257e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:04:17 devstack cinder-volume[82603]: DEBUG cinder.volume.drivers.quobyte [None req-a0ebe97d-9a8b-4545-bc11-91adf052257e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:04:17 devstack cinder-volume[82603]: DEBUG oslo_concurrency.lockutils [None req-a0ebe97d-9a8b-4545-bc11-91adf052257e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82603) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:04:17 devstack cinder-volume[82603]: DEBUG oslo_concurrency.processutils [None req-a0ebe97d-9a8b-4545-bc11-91adf052257e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:04:17 devstack sudo[82752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:04:17 devstack sudo[82752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:04:17 devstack sudo[82752]: pam_unix(sudo:session): session closed for user root Apr 15 20:04:17 devstack cinder-volume[82603]: DEBUG oslo_concurrency.processutils [None req-a0ebe97d-9a8b-4545-bc11-91adf052257e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.364s {{(pid=82603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:04:17 devstack cinder-volume[82603]: DEBUG cinder.manager [None req-a0ebe97d-9a8b-4545-bc11-91adf052257e None None] Notifying Schedulers of capabilities ... {{(pid=82603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:04:21 devstack cinder-volume[82487]: INFO oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Caught SIGTERM, stopping children Apr 15 20:04:21 devstack cinder-volume[82487]: DEBUG oslo_concurrency.lockutils [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Acquiring lock "singleton_lock" {{(pid=82487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 20:04:21 devstack cinder-volume[82487]: DEBUG oslo_concurrency.lockutils [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Acquired lock "singleton_lock" {{(pid=82487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 20:04:21 devstack cinder-volume[82487]: DEBUG oslo_concurrency.lockutils [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Releasing lock "singleton_lock" {{(pid=82487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 20:04:21 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Stop services. {{(pid=82487) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 15 20:04:21 devstack cinder-volume[82487]: DEBUG oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Killing children. {{(pid=82487) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 15 20:04:21 devstack cinder-volume[82487]: INFO oslo_service.backend._eventlet.service [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Waiting on 1 children to exit Apr 15 20:04:24 devstack cinder-volume[82603]: DEBUG dbcounter [-] [82603] Writing DB stats cinder:SELECT=3 {{(pid=82603) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:04:24 devstack cinder-volume[82603]: DEBUG dbcounter [-] [82603] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=82603) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:04:25 devstack cinder-volume[82603]: DEBUG oslo_concurrency.lockutils [None req-42abe966-0513-4581-b2e4-afc3e3321dd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82603) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:04:25 devstack cinder-volume[82603]: DEBUG oslo_concurrency.lockutils [None req-42abe966-0513-4581-b2e4-afc3e3321dd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82603) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:04:25 devstack cinder-volume[82603]: DEBUG cinder.volume.drivers.quobyte [None req-42abe966-0513-4581-b2e4-afc3e3321dd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:04:25 devstack cinder-volume[82603]: DEBUG cinder.volume.drivers.quobyte [None req-42abe966-0513-4581-b2e4-afc3e3321dd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:04:25 devstack cinder-volume[82603]: DEBUG oslo_concurrency.lockutils [None req-42abe966-0513-4581-b2e4-afc3e3321dd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82603) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:04:25 devstack cinder-volume[82603]: DEBUG oslo_concurrency.processutils [None req-42abe966-0513-4581-b2e4-afc3e3321dd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:04:25 devstack sudo[82843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:04:25 devstack sudo[82843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:04:26 devstack sudo[82843]: pam_unix(sudo:session): session closed for user root Apr 15 20:04:26 devstack cinder-volume[82603]: DEBUG oslo_concurrency.processutils [None req-42abe966-0513-4581-b2e4-afc3e3321dd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.429s {{(pid=82603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:04:26 devstack cinder-volume[82603]: DEBUG cinder.manager [None req-42abe966-0513-4581-b2e4-afc3e3321dd7 None None] Notifying Schedulers of capabilities ... {{(pid=82603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:04:26 devstack cinder-volume[82603]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Apr 15 20:04:26 devstack cinder-volume[82854]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 20:04:26 devstack cinder-volume[82854]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 20:04:26 devstack cinder-volume[82854]: we strongly recommend against using it for new projects. Apr 15 20:04:26 devstack cinder-volume[82854]: If you are already using Eventlet, we recommend migrating to a different Apr 15 20:04:26 devstack cinder-volume[82854]: framework. For more detail see Apr 15 20:04:26 devstack cinder-volume[82854]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 20:04:26 devstack cinder-volume[82854]: import eventlet # noqa Apr 15 20:04:27 devstack cinder-volume[82603]: DEBUG oslo_concurrency.lockutils [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Acquiring lock "singleton_lock" {{(pid=82603) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 20:04:27 devstack cinder-volume[82603]: DEBUG oslo_concurrency.lockutils [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Acquired lock "singleton_lock" {{(pid=82603) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 20:04:27 devstack cinder-volume[82603]: DEBUG oslo_concurrency.lockutils [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Releasing lock "singleton_lock" {{(pid=82603) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 20:04:27 devstack cinder-volume[82603]: WARNING amqp [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 20:04:27 devstack cinder-volume[82603]: WARNING amqp [None req-6aef656a-3107-4507-a29c-3157a31398af None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 20:04:28 devstack cinder-volume[82854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 20:04:28 devstack cinder-volume[82854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 20:04:28 devstack cinder-volume[82854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 20:04:28 devstack cinder-volume[82854]: INFO dbcounter [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] Registered counter for database cinder Apr 15 20:04:28 devstack cinder-volume[82854]: DEBUG oslo_db.sqlalchemy.engines [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82854) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG dbcounter [-] [82854] Writer thread running {{(pid=82854) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 20:04:29 devstack cinder-volume[82854]: INFO cinder.rpc [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 20:04:29 devstack cinder-volume[82854]: INFO cinder.rpc [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_db.sqlalchemy.engines [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82854) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 20:04:29 devstack cinder-volume[82854]: INFO cinder.volume.manager [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] Determined volume DB was empty at startup. Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG cinder.volume.manager [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82854) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 20:04:29 devstack cinder-volume[82854]: WARNING stevedore.named [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 20:04:29 devstack cinder-volume[82854]: WARNING castellan.key_manager [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 20:04:29 devstack cinder-volume[82854]: WARNING cinder.keymgr.conf_key_mgr [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 20:04:29 devstack cinder-volume[82854]: INFO cinder.volume.manager [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_db.sqlalchemy.engines [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82854) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 20:04:29 devstack cinder-volume[82854]: INFO oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] Starting 1 workers Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] Started child 82989 {{(pid=82854) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] Full set of CONF: {{(pid=82854) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] ******************************************************************************** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] Configuration options gathered from: {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] ================================================================================ {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] allow_availability_zone_fallback = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] allow_compression_on_image_upload = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] allowed_direct_url_schemes = [] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] api_rate_limit = True {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] auth_strategy = keystone {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_availability_zone = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_host = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82989]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_name = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_stats_polling_interval = 60 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backup_api_class = cinder.backup.api.API {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backup_name_template = backup-%s {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backup_use_same_host = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backup_use_temp_snapshot = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] chap_password = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] chap_username = {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cinder_internal_tenant_project_id = ee32fb58184f479b8cef64581977bd99 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cinder_internal_tenant_user_id = 47c73541f6924eba8bedfbd260dad63a {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cluster = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] compression_format = gzip {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] compute_api_class = cinder.compute.nova.API {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] config_dir = [] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] config_source = [] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] control_exchange = openstack {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] debug = True {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] default_availability_zone = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] default_group_type = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] default_volume_type = QuobyteHD {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] disk_geometry = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] driver_client_cert = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] driver_client_cert_key = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] driver_data_namespace = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] driver_ssl_cert_path = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] driver_ssl_cert_verify = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] driver_use_ssl = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] enable_new_services = True {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] enable_unsupported_driver = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] enabled_backends = ['QuobyteHD'] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] enforce_multipath_for_image_xfer = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] filter_function = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] glance_api_insecure = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] glance_api_servers = ['http://192.168.122.251/image'] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] glance_api_ssl_compression = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] glance_ca_certificates_file = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] glance_catalog_info = image:glance:publicURL {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] glance_certfile = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] glance_keyfile = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] glance_num_retries = 3 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] glance_request_timeout = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] goodness_function = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] graceful_shutdown_timeout = 5 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] group_api_class = cinder.group.api.API {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] host = devstack {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] image_compress_on_upload = True {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] image_conversion_address_space_limit = 1 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] image_conversion_cpu_limit = 60 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] image_conversion_disable = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] image_upload_use_cinder_backend = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] image_upload_use_internal_tenant = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] image_volume_cache_enabled = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] image_volume_cache_max_count = 0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] image_volume_cache_max_size_gb = 0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] init_host_max_objects_retrieval = 0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] instance_format = [instance: %(uuid)s] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] iscsi_target_flags = {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] iscsi_write_cache = on {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] iser_helper = tgtadm {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] iser_ip_address = 192.168.122.251 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] iser_port = 3260 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] log_color = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] log_config_append = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] log_dir = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] log_file = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] log_options = True {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] log_rotate_interval = 1 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] log_rotate_interval_type = days {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] log_rotation_type = none {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] max_age = 0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] max_logfile_count = 30 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] max_logfile_size_mb = 200 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] max_over_subscription_ratio = 20.0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] message_reap_interval = 86400 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] message_ttl = 2592000 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] migration_create_volume_timeout_secs = 300 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] monkey_patch = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] monkey_patch_modules = [] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] my_ip = 192.168.122.251 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] no_snapshot_gb_quota = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] num_iser_scan_tries = 3 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] num_shell_tries = 3 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] num_volume_device_scan_tries = 3 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] nvmeof_conn_info_version = 1 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] nvmet_ns_id = 10 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] nvmet_port_id = 1 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] osapi_max_limit = 1000 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] osapi_volume_ext_list = [] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] osapi_volume_listen_port = 8776 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] osapi_volume_use_ssl = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] osapi_volume_workers = 2 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] per_volume_size_limit = -1 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] periodic_fuzzy_delay = 60 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] periodic_interval = 60 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] public_endpoint = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] publish_errors = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] quota_backup_gigabytes = 1000 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] quota_backups = 10 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] quota_gigabytes = 1000 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] quota_groups = 10 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] quota_snapshots = 10 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] quota_volumes = 10 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] rate_limit_burst = 0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] rate_limit_except_level = CRITICAL {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] rate_limit_interval = 0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] reinit_driver_count = 3 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] replication_device = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] report_discard_supported = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] report_interval = 120 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] reservation_clean_interval = 86400 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] reservation_expire = 86400 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] reserved_image_namespaces = [] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] reserved_percentage = 0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] rpc_response_timeout = 120 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] run_external_periodic_tasks = True {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] scst_target_driver = iscsi {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] scst_target_iqn_name = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] service_down_time = 720 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] shell_completion = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] snapshot_name_template = snapshot-%s {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] split_loggers = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] state_path = /opt/stack/data/cinder {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] storage_availability_zone = nova {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] storage_protocol = iSCSI {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] syslog_log_facility = LOG_USER {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] target_helper = lioadm {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] target_ip_address = 192.168.122.251 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] target_port = 3260 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] target_protocol = iscsi {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82989) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] target_secondary_ip_addresses = [] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] trace_flags = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] transport_url = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] until_refresh = 0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] use_chap_auth = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] use_default_quota_class = True {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] use_journal = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] use_json = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] use_multipath_for_image_xfer = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] use_stderr = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] use_syslog = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] verify_glance_signatures = enabled {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] volume_api_class = cinder.volume.api.API {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] volume_backend_name = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] volume_clear = zero {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] volume_clear_ionice = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] volume_clear_size = 0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] volume_copy_bps_limit = 0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] volume_dd_blocksize = 1M {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] volume_name_template = volume-%s {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] volume_service_inithost_offload = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] volume_usage_audit_period = month {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] zoning_mode = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_concurrency.disable_process_locking = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.admin_password = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.admin_token = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.admin_user = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.auth_port = 35357 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.auth_protocol = https {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.auth_section = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.auth_type = password {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.auth_uri = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.auth_version = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.cache = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.certfile = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.identity_uri = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.include_service_catalog = True {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.insecure = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.interface = public {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.keyfile = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.memcache_password = {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.memcache_username = {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.region_name = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.service_type = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.backend = dogpile.cache.null {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.backend_argument = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.backend_expiration_time = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.config_prefix = cache.oslo {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.debug_cache_backend = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.enable_retry_client = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.enable_socket_keepalive = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.enabled = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.enforce_fips_mode = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.expiration_time = 600 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.hashclient_retry_attempts = 2 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.memcache_dead_retry = 300 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.memcache_pool_maxsize = 10 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.memcache_sasl_enabled = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.password = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.proxies = [] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.redis_db = 0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.redis_server = localhost:6379 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.retry_attempts = 2 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.retry_delay = 0.0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.socket_keepalive_count = 1 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.socket_keepalive_idle = 1 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.socket_keepalive_interval = 1 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.socket_timeout = 1.0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.tls_allowed_ciphers = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.tls_cafile = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.tls_certfile = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.tls_enabled = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.tls_keyfile = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cache.username = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] coordination.backend_url = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] database.asyncio_connection = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] database.asyncio_slave_connection = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] database.backend = sqlalchemy {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] database.connection = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] database.connection_debug = 0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] database.connection_parameters = {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] database.connection_recycle_time = 3600 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] database.connection_trace = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] database.db_inc_retry_interval = True {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] database.db_max_retries = 20 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] database.db_max_retry_interval = 10 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] database.db_retry_interval = 1 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] database.max_overflow = 50 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] database.max_pool_size = 5 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] database.max_retries = 10 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] database.mysql_wsrep_sync_wait = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] database.pool_timeout = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] database.retry_interval = 10 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] database.slave_connection = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] database.sqlite_synchronous = True {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] database.synchronous_reader = True {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] database.use_db_reconnect = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] profiler.connection_string = messaging:// {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] profiler.enabled = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] profiler.es_doc_type = notification {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] profiler.es_scroll_size = 10000 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] profiler.es_scroll_time = 2m {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] profiler.filter_error_trace = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] profiler.hmac_keys = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] profiler.sentinel_service_name = mymaster {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] profiler.socket_timeout = 0.1 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] profiler.trace_requests = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] profiler.trace_sqlalchemy = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] profiler_jaeger.process_tags = {} {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] profiler_jaeger.service_name_prefix = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] profiler_otlp.service_name_prefix = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_policy.enforce_new_defaults = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: WARNING oslo_config.cfg [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_policy.enforce_scope = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_policy.policy_default_rule = default {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_policy.policy_file = policy.yaml {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] privsep_osbrick.group = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] privsep_osbrick.helper_command = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] privsep_osbrick.user = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cinder_sys_admin.group = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cinder_sys_admin.helper_command = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] cinder_sys_admin.user = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] service_user.auth_section = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] service_user.auth_type = password {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] service_user.cafile = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] service_user.certfile = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] service_user.collect_timing = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] service_user.insecure = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] service_user.keyfile = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] service_user.send_service_user_token = True {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] service_user.split_loggers = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] service_user.timeout = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] glance.auth_section = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] glance.auth_type = password {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] glance.certfile = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] glance.collect_timing = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] glance.insecure = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] glance.keyfile = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] glance.region_name = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] glance.split_loggers = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] glance.timeout = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.backend_availability_zone = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.chap_password = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.chap_username = {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.disk_geometry = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.driver_client_cert = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.driver_client_cert_key = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.driver_data_namespace = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.driver_use_ssl = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.extra_capabilities = {} {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.filter_function = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.goodness_function = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.iscsi_target_flags = {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.iscsi_write_cache = on {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.iser_helper = tgtadm {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.iser_port = 3260 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.nas_host = {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.nas_login = admin {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.nas_mount_options = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.nas_password = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.nas_private_key = {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.nas_share_path = {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82989) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.num_shell_tries = 3 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.quobyte [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.quobyte [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Running cmd (subprocess): mount.quobyte {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.quobyte_volume_url = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.replication_device = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.report_discard_supported = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.reserved_percentage = 0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.target_helper = tgtadm {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.target_port = 3260 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.target_protocol = iscsi {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.trace_flags = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.unique_fqdn_network = True {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.use_chap_auth = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.volume_backend_name = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.volume_clear = zero {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.volume_clear_ionice = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.volume_clear_size = 0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_reports.file_event_handler = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_reports.log_dir = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.backend_availability_zone = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.backend_host = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.chap_password = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.chap_username = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.chiscsi_conf = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.disk_geometry = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.driver_client_cert = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.driver_data_namespace = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.driver_use_ssl = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.extra_capabilities = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.filter_function = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.goodness_function = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.iser_helper = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.iser_ip_address = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.iser_port = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.iser_target_prefix = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.nas_host = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.nas_login = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.nas_mount_options = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.nas_password = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.nas_private_key = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.nas_share_path = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.nas_ssh_port = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.num_shell_tries = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.nvmet_port_id = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.replication_device = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.report_discard_supported = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.reserved_percentage = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.scst_target_driver = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.storage_protocol = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.target_helper = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.target_ip_address = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.target_port = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.target_prefix = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.target_protocol = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.trace_flags = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.use_chap_auth = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.volume_clear = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.volume_clear_size = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] QuobyteHD.volumes_dir = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.ssl = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_notifications.driver = [] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_notifications.retry = -1 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] key_manager.fixed_key = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican.barbican_api_version = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican.barbican_endpoint = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican.barbican_endpoint_type = public {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican.barbican_region_name = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican.cafile = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican.certfile = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican.collect_timing = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican.insecure = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican.keyfile = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican.number_of_retries = 60 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican.retry_delay = 1 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican.send_service_user_token = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican.split_loggers = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican.timeout = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican.verify_ssl = True {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican.verify_ssl_path = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican_service_user.auth_section = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican_service_user.auth_type = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican_service_user.cafile = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican_service_user.certfile = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican_service_user.collect_timing = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican_service_user.insecure = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican_service_user.keyfile = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican_service_user.split_loggers = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] barbican_service_user.timeout = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] vault.approle_role_id = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] vault.approle_secret_id = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] vault.kv_mountpoint = secret {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] vault.kv_path = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] vault.kv_version = 2 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] vault.namespace = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] vault.root_token_id = **** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] vault.ssl_ca_crt_file = None {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] vault.timeout = 60.0 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] vault.use_ssl = False {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 20:04:29 devstack cinder-volume[82854]: DEBUG oslo_service.backend._eventlet.service [None req-796319ae-8bb7-4311-b9e9-f1181a67f309 None None] ******************************************************************************** {{(pid=82854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 20:04:29 devstack quobyte-client[83002]: Reading configuration file: /etc/quobyte/client.cfg Apr 15 20:04:29 devstack quobyte-client[83002]: Invalid parameters found, error: missing mount point. Apr 15 20:04:29 devstack quobyte-client[83002]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 15 20:04:29 devstack quobyte-client[83002]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 15 20:04:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] CMD "mount.quobyte" returned: 1 in 0.075s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:04:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:04:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:04:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:04:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:04:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:04:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:04:29 devstack sudo[83021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:04:29 devstack sudo[83021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:04:29 devstack sudo[83021]: pam_unix(sudo:session): session closed for user root Apr 15 20:04:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.395s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:04:29 devstack cinder-volume[82989]: INFO cinder.volume.driver [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Driver hasn't implemented _init_vendor_properties() Apr 15 20:04:29 devstack cinder-volume[82989]: DEBUG cinder.volume.driver [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7328071594238, 'free_capacity_gb': 1775.7328071594238, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82989) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 20:04:29 devstack cinder-volume[82989]: DEBUG oslo_db.sqlalchemy.engines [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82989) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 20:04:29 devstack cinder-volume[82989]: DEBUG dbcounter [-] [82989] Writer thread running {{(pid=82989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 20:04:29 devstack cinder-volume[82989]: DEBUG cinder.db.sqlalchemy.api [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Building query based on filter {{(pid=82989) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 20:04:29 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82989) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 20:04:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:04:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:04:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:04:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:04:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:04:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:04:29 devstack cinder-volume[82989]: INFO cinder.keymgr.migration [None req-b96884f9-c62d-4ce0-a266-6be070ee463d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 20:04:29 devstack sudo[83060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:04:29 devstack sudo[83060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:04:30 devstack sudo[83060]: pam_unix(sudo:session): session closed for user root Apr 15 20:04:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.368s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:04:30 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:04:30 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Driver initialization completed successfully. Apr 15 20:04:30 devstack cinder-volume[82989]: INFO cinder.manager [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Initiating service 3 cleanup Apr 15 20:04:30 devstack cinder-volume[82989]: INFO cinder.manager [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Service 3 cleanup completed. Apr 15 20:04:30 devstack cinder-volume[82989]: DEBUG cinder.service [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Creating RPC server for service cinder-volume {{(pid=82989) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 20:04:30 devstack cinder-volume[82989]: DEBUG cinder.service [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82989) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 20:04:30 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 15 20:04:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:04:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:04:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:04:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:04:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:04:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:04:30 devstack sudo[83077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:04:30 devstack sudo[83077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:04:30 devstack sudo[83077]: pam_unix(sudo:session): session closed for user root Apr 15 20:04:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.378s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:04:30 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-c195265a-3e61-47aa-8d45-5293fc15a687 None None] Driver post RPC initialization completed successfully. Apr 15 20:04:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2f764cbf-bac8-4a8c-ba8b-bbd23ef9de88 tempest-BackendsCapabilitiesAdminTestsJSON-1719712245 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7328071594238, 'free_capacity_gb': 1775.7328071594238, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82989) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 15 20:04:38 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-088e1099-3f3b-4723-92ef-ec71c89b4a6c tempest-BackendsCapabilitiesAdminTestsJSON-1719712245 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7328071594238, 'free_capacity_gb': 1775.7328071594238, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82989) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 15 20:04:39 devstack cinder-volume[82854]: DEBUG dbcounter [-] [82854] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82854) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:04:40 devstack cinder-volume[82989]: DEBUG dbcounter [-] [82989] Writing DB stats cinder:SELECT=3 {{(pid=82989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:04:40 devstack cinder-volume[82989]: DEBUG dbcounter [-] [82989] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Flow 'volume_create_manager' (a32b563f-81f6-45a4-bda2-441eb3f173c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368dbb3e-70d6-41e1-bb1e-2f8c8da8868c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368dbb3e-70d6-41e1-bb1e-2f8c8da8868c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1607101040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6238198e-cf59-4cef-ba4e-62e3e5b75f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f496480044b84cad97e77ca7bf6b8bd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:05:26Z,use_quota=True,user_id='b283fc44d8be4b1a8a25f71cbbd1c60c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3504de4-68cf-49d4-8f0b-64e38d42e86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3504de4-68cf-49d4-8f0b-64e38d42e86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926e5ac6-2015-4e68-b856-8b609798c925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926e5ac6-2015-4e68-b856-8b609798c925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6238198e-cf59-4cef-ba4e-62e3e5b75f6a', 'volume_name': 'volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e524ae8-0506-479f-9d1c-906a82be3557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e524ae8-0506-479f-9d1c-906a82be3557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3dc3be3-ce9d-4fe7-bc11-86e84757ba2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:26 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Volume 6238198e-cf59-4cef-ba4e-62e3e5b75f6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a', 'volume_size': 1} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1607101040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6238198e-cf59-4cef-ba4e-62e3e5b75f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f496480044b84cad97e77ca7bf6b8bd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:05:26Z,use_quota=True,user_id='b283fc44d8be4b1a8a25f71cbbd1c60c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Creating volume 6238198e-cf59-4cef-ba4e-62e3e5b75f6a {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:05:26 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:26 devstack sudo[83388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a 1073741824 Apr 15 20:05:26 devstack sudo[83388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Flow 'volume_create_manager' (390e77c7-f437-4903-9829-adefa76623e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6563fe-6d6c-4d58-8c75-e98d09892f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6563fe-6d6c-4d58-8c75-e98d09892f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1852033463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e423feff-1c9f-4d9f-8af1-fbdb1ffba078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b22bf4907b524931aac4b17f9432f83a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:05:27Z,use_quota=True,user_id='b7feb5ea463c41159b4de0e62a947a15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c702c1-2288-4161-9169-b509dd085db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:26 devstack sudo[83388]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c702c1-2288-4161-9169-b509dd085db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a61170a-3213-4328-bdc5-888d1aed5d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a61170a-3213-4328-bdc5-888d1aed5d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e423feff-1c9f-4d9f-8af1-fbdb1ffba078', 'volume_name': 'volume-e423feff-1c9f-4d9f-8af1-fbdb1ffba078', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ae1db6-b1aa-4c99-82ea-6cd89a492822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ae1db6-b1aa-4c99-82ea-6cd89a492822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d10872-e2c3-420b-8d91-b117f57cd860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:26 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Volume e423feff-1c9f-4d9f-8af1-fbdb1ffba078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e423feff-1c9f-4d9f-8af1-fbdb1ffba078', 'volume_size': 1} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:05:26 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-776c5452-3ba1-412a-a8e1-f7405daf4d31 tempest-GroupsTest-1845340366 None] Group tempest-Group1-349815433: creating Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a 1073741824" returned: 0 in 0.653s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:26 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-776c5452-3ba1-412a-a8e1-f7405daf4d31 tempest-GroupsTest-1845340366 None] Group tempest-Group1-349815433: created successfully Apr 15 20:05:26 devstack sudo[83712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a Apr 15 20:05:26 devstack sudo[83712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:26 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-776c5452-3ba1-412a-a8e1-f7405daf4d31 tempest-GroupsTest-1845340366 None] Create group completed successfully. Apr 15 20:05:27 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-b198947d-14f7-4087-929b-8b764f43e370 tempest-GroupsTest-1845340366 None] Group tempest-Group2-969135530: creating Apr 15 20:05:27 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-b198947d-14f7-4087-929b-8b764f43e370 tempest-GroupsTest-1845340366 None] Group tempest-Group2-969135530: created successfully Apr 15 20:05:27 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-b198947d-14f7-4087-929b-8b764f43e370 tempest-GroupsTest-1845340366 None] Create group completed successfully. Apr 15 20:05:27 devstack sudo[83712]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a" returned: 0 in 0.774s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:05:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:05:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.827s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:05:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1852033463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e423feff-1c9f-4d9f-8af1-fbdb1ffba078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b22bf4907b524931aac4b17f9432f83a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:05:27Z,use_quota=True,user_id='b7feb5ea463c41159b4de0e62a947a15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:05:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Creating volume e423feff-1c9f-4d9f-8af1-fbdb1ffba078 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:05:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:05:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:05:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:05:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:05:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:05:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:05:27 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:05:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e423feff-1c9f-4d9f-8af1-fbdb1ffba078 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:27 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3dc3be3-ce9d-4fe7-bc11-86e84757ba2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:27 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce87895-5c4a-49d3-8c36-2f4a2827ae3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:27 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Volume volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a (6238198e-cf59-4cef-ba4e-62e3e5b75f6a): created successfully Apr 15 20:05:27 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce87895-5c4a-49d3-8c36-2f4a2827ae3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:27 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Flow 'volume_create_manager' (a32b563f-81f6-45a4-bda2-441eb3f173c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:05:27 devstack sudo[83725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e423feff-1c9f-4d9f-8af1-fbdb1ffba078 1073741824 Apr 15 20:05:27 devstack sudo[83725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:27 devstack cinder-volume[82989]: INFO cinder.volume.manager [req-f33f9d2a-e978-47ff-9436-b16285202064 req-1a5b1d0d-43cc-4189-8c90-49cab8e5cdb9 tempest-VolumesSnapshotsTestJSON-330653950 None] Created volume successfully. Apr 15 20:05:28 devstack sudo[83725]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e423feff-1c9f-4d9f-8af1-fbdb1ffba078 1073741824" returned: 0 in 0.625s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e423feff-1c9f-4d9f-8af1-fbdb1ffba078 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:28 devstack sudo[83733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e423feff-1c9f-4d9f-8af1-fbdb1ffba078 Apr 15 20:05:28 devstack sudo[83733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:28 devstack sudo[83733]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e423feff-1c9f-4d9f-8af1-fbdb1ffba078" returned: 0 in 0.458s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:28 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:05:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:05:28 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d10872-e2c3-420b-8d91-b117f57cd860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e423feff-1c9f-4d9f-8af1-fbdb1ffba078', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:28 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbafc380-8804-4f64-ae43-0e5ca23a4ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:28 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Volume volume-e423feff-1c9f-4d9f-8af1-fbdb1ffba078 (e423feff-1c9f-4d9f-8af1-fbdb1ffba078): created successfully Apr 15 20:05:28 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbafc380-8804-4f64-ae43-0e5ca23a4ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:28 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Flow 'volume_create_manager' (390e77c7-f437-4903-9829-adefa76623e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:05:28 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-8b5060fb-af73-46c1-aeb2-3c7cfaf48192 tempest-VolumesAdminNegativeTest-525853204 None] Created volume successfully. Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Flow 'volume_create_manager' (e67673a2-c5b5-404f-94ba-28d7fd1c8512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2547bb9e-1343-43d1-99f6-30b2b77c176d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2547bb9e-1343-43d1-99f6-30b2b77c176d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1129920967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=076bfe74-2319-4af3-87bc-0d0861f55720,host='devstack@QuobyteHD#QuobyteHD',id=46cc59c7-037a-4001-ace0-a08bec9ecf89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa462b9de55439c8782a4f7210b9545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:05:29Z,use_quota=True,user_id='c7d3734f72774cc0b64ce6b9a40e1254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee056944-ab45-495f-b051-92959751a7f6),volume_type_id=ee056944-ab45-495f-b051-92959751a7f6)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074c3968-1df5-4ea5-b1c9-cebf7df26987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074c3968-1df5-4ea5-b1c9-cebf7df26987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9954d437-16eb-40e1-9f96-586d0c927fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9954d437-16eb-40e1-9f96-586d0c927fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46cc59c7-037a-4001-ace0-a08bec9ecf89', 'volume_name': 'volume-46cc59c7-037a-4001-ace0-a08bec9ecf89', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a062f33-8b34-46ba-9a46-914ca6748de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a062f33-8b34-46ba-9a46-914ca6748de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2592aa5d-a629-44db-839a-828073edf3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:29 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Volume 46cc59c7-037a-4001-ace0-a08bec9ecf89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46cc59c7-037a-4001-ace0-a08bec9ecf89', 'volume_size': 1} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=076bfe74-2319-4af3-87bc-0d0861f55720,created_at=2026-04-15T18:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1129920967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=076bfe74-2319-4af3-87bc-0d0861f55720,host='devstack@QuobyteHD#QuobyteHD',id=46cc59c7-037a-4001-ace0-a08bec9ecf89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa462b9de55439c8782a4f7210b9545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:05:29Z,use_quota=True,user_id='c7d3734f72774cc0b64ce6b9a40e1254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee056944-ab45-495f-b051-92959751a7f6),volume_type_id=ee056944-ab45-495f-b051-92959751a7f6)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Creating volume 46cc59c7-037a-4001-ace0-a08bec9ecf89 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:05:29 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-46cc59c7-037a-4001-ace0-a08bec9ecf89 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-bc931f1e-e8db-4b57-bc12-66723f21e450 req-9c11b552-3188-41b3-a6f4-9b248b8f24b5 tempest-VolumesSnapshotsTestJSON-330653950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:05:29 devstack sudo[83757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-46cc59c7-037a-4001-ace0-a08bec9ecf89 1073741824 Apr 15 20:05:29 devstack sudo[83757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] Acquiring lock "cinder-e423feff-1c9f-4d9f-8af1-fbdb1ffba078-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] Lock "cinder-e423feff-1c9f-4d9f-8af1-fbdb1ffba078-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] Acquiring lock "cinder-quobyte-e423feff-1c9f-4d9f-8af1-fbdb1ffba078" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] Lock "cinder-quobyte-e423feff-1c9f-4d9f-8af1-fbdb1ffba078" acquired by "delete_volume" :: waited 0.006s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:05:29 devstack cinder-volume[82989]: INFO oslo.privsep.daemon [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmprgcmwket/privsep.sock'] Apr 15 20:05:29 devstack sudo[83760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmprgcmwket/privsep.sock Apr 15 20:05:29 devstack sudo[83760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:29 devstack sudo[83757]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-46cc59c7-037a-4001-ace0-a08bec9ecf89 1073741824" returned: 0 in 0.586s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-46cc59c7-037a-4001-ace0-a08bec9ecf89 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:29 devstack sudo[83766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-46cc59c7-037a-4001-ace0-a08bec9ecf89 Apr 15 20:05:29 devstack sudo[83766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:30 devstack cinder-volume[82989]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 15 20:05:30 devstack cinder-volume[82989]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 20:05:30 devstack cinder-volume[82989]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 15 20:05:30 devstack cinder-volume[82989]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 20:05:30 devstack cinder-volume[82989]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 15 20:05:30 devstack cinder-volume[82989]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 15 20:05:30 devstack cinder-volume[82989]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 20:05:30 devstack cinder-volume[82989]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 20:05:30 devstack cinder-volume[82989]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 15 20:05:30 devstack sudo[83766]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-46cc59c7-037a-4001-ace0-a08bec9ecf89" returned: 0 in 0.450s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:05:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:05:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-bc931f1e-e8db-4b57-bc12-66723f21e450 req-9c11b552-3188-41b3-a6f4-9b248b8f24b5 tempest-VolumesSnapshotsTestJSON-330653950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.029s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:05:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2592aa5d-a629-44db-839a-828073edf3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46cc59c7-037a-4001-ace0-a08bec9ecf89', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363fa581-484e-4c7b-be63-eda8ab8f6c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [req-bc931f1e-e8db-4b57-bc12-66723f21e450 req-9c11b552-3188-41b3-a6f4-9b248b8f24b5 tempest-VolumesSnapshotsTestJSON-330653950 None] Creating offline snapshot e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc of volume 6238198e-cf59-4cef-ba4e-62e3e5b75f6a {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:05:30 devstack cinder-volume[82989]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 15 20:05:30 devstack cinder-volume[82989]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 20:05:30 devstack cinder-volume[82989]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 15 20:05:30 devstack cinder-volume[82989]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 20:05:30 devstack cinder-volume[82989]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 15 20:05:30 devstack cinder-volume[82989]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 15 20:05:30 devstack cinder-volume[82989]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 20:05:30 devstack cinder-volume[82989]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 20:05:30 devstack cinder-volume[82989]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 15 20:05:30 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Volume volume-46cc59c7-037a-4001-ace0-a08bec9ecf89 (46cc59c7-037a-4001-ace0-a08bec9ecf89): created successfully Apr 15 20:05:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363fa581-484e-4c7b-be63-eda8ab8f6c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Flow 'volume_create_manager' (e67673a2-c5b5-404f-94ba-28d7fd1c8512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:05:30 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-d52674b0-02c0-48f5-8505-2f8dcf8acb9f tempest-GroupsTest-1845340366 None] Created volume successfully. Apr 15 20:05:30 devstack sudo[83760]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:30 devstack cinder-volume[82989]: INFO oslo.privsep.daemon [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] Spawned new privsep daemon via rootwrap Apr 15 20:05:30 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] Accepted privsep connection to /tmp/tmprgcmwket/privsep.sock {{(pid=82989) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 15 20:05:30 devstack cinder-volume[82989]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 15 20:05:30 devstack cinder-volume[82989]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 15 20:05:30 devstack cinder-volume[82989]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 15 20:05:30 devstack cinder-volume[82989]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83770 Apr 15 20:05:30 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[825869b9-46a1-4ea5-9278-b05527ca2c83]: (2,) {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:05:30 devstack cinder-volume[82989]: WARNING oslo_privsep.priv_context [req-bc931f1e-e8db-4b57-bc12-66723f21e450 req-9c11b552-3188-41b3-a6f4-9b248b8f24b5 tempest-VolumesSnapshotsTestJSON-330653950 None] privsep daemon already running Apr 15 20:05:30 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[44742660-0a2c-4460-a66f-f07b7e44f151]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:05:30 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f30c089-1891-41bc-9827-9fbae2d99226]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:05:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e423feff-1c9f-4d9f-8af1-fbdb1ffba078 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-bc931f1e-e8db-4b57-bc12-66723f21e450 req-9c11b552-3188-41b3-a6f4-9b248b8f24b5 tempest-VolumesSnapshotsTestJSON-330653950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:30 devstack sudo[83774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e423feff-1c9f-4d9f-8af1-fbdb1ffba078 Apr 15 20:05:30 devstack sudo[83774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:30 devstack sudo[83775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a Apr 15 20:05:30 devstack sudo[83775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:31 devstack sudo[83774]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e423feff-1c9f-4d9f-8af1-fbdb1ffba078" returned: 0 in 0.461s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e423feff-1c9f-4d9f-8af1-fbdb1ffba078 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:31 devstack sudo[83785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e423feff-1c9f-4d9f-8af1-fbdb1ffba078 Apr 15 20:05:31 devstack sudo[83785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:31 devstack sudo[83775]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-bc931f1e-e8db-4b57-bc12-66723f21e450 req-9c11b552-3188-41b3-a6f4-9b248b8f24b5 tempest-VolumesSnapshotsTestJSON-330653950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a" returned: 0 in 0.483s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-bc931f1e-e8db-4b57-bc12-66723f21e450 req-9c11b552-3188-41b3-a6f4-9b248b8f24b5 tempest-VolumesSnapshotsTestJSON-330653950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:31 devstack sudo[83787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc 1G Apr 15 20:05:31 devstack sudo[83787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:31 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-931be88f-8bc1-4452-9ac3-d508cc6be347 tempest-GroupsTest-1845340366 None] Acquiring lock "cinder-quobyte-46cc59c7-037a-4001-ace0-a08bec9ecf89" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:05:31 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-931be88f-8bc1-4452-9ac3-d508cc6be347 tempest-GroupsTest-1845340366 None] Lock "cinder-quobyte-46cc59c7-037a-4001-ace0-a08bec9ecf89" acquired by "delete_volume" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:05:31 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d64aea-a9c4-45b1-a457-6f4047b431ee]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:05:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-931be88f-8bc1-4452-9ac3-d508cc6be347 tempest-GroupsTest-1845340366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-46cc59c7-037a-4001-ace0-a08bec9ecf89 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:32 devstack sudo[83785]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e423feff-1c9f-4d9f-8af1-fbdb1ffba078" returned: 0 in 0.683s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] Lock "cinder-quobyte-e423feff-1c9f-4d9f-8af1-fbdb1ffba078" released by "delete_volume" :: held 2.301s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:05:32 devstack sudo[83787]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-bc931f1e-e8db-4b57-bc12-66723f21e450 req-9c11b552-3188-41b3-a6f4-9b248b8f24b5 tempest-VolumesSnapshotsTestJSON-330653950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc 1G" returned: 0 in 0.702s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:32 devstack sudo[83797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-46cc59c7-037a-4001-ace0-a08bec9ecf89 Apr 15 20:05:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-bc931f1e-e8db-4b57-bc12-66723f21e450 req-9c11b552-3188-41b3-a6f4-9b248b8f24b5 tempest-VolumesSnapshotsTestJSON-330653950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:32 devstack sudo[83797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:32 devstack cinder-volume[82989]: WARNING cinder.quota [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:05:32 devstack cinder-volume[82989]: WARNING cinder.quota [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:05:32 devstack sudo[83800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc Apr 15 20:05:32 devstack sudo[83800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:32 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] Created reservations ['548f9528-7e1e-47a1-88d9-275fc1565b6f', 'b5c06037-6769-49ac-ac3d-bd39899b1ee8', 'db04ed14-3877-446a-a5a0-fee76526883d', '9989dd41-9d3e-4375-ac33-8a5e8369dfb3'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:05:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:05:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:05:32 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:05:32 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:05:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:05:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:32 devstack sudo[83802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:05:32 devstack sudo[83802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:32 devstack sudo[83797]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-931be88f-8bc1-4452-9ac3-d508cc6be347 tempest-GroupsTest-1845340366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-46cc59c7-037a-4001-ace0-a08bec9ecf89" returned: 0 in 0.503s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-931be88f-8bc1-4452-9ac3-d508cc6be347 tempest-GroupsTest-1845340366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-46cc59c7-037a-4001-ace0-a08bec9ecf89 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:32 devstack sudo[83813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-46cc59c7-037a-4001-ace0-a08bec9ecf89 Apr 15 20:05:32 devstack sudo[83813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:32 devstack sudo[83800]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-bc931f1e-e8db-4b57-bc12-66723f21e450 req-9c11b552-3188-41b3-a6f4-9b248b8f24b5 tempest-VolumesSnapshotsTestJSON-330653950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc" returned: 0 in 0.444s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:32 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [req-bc931f1e-e8db-4b57-bc12-66723f21e450 req-9c11b552-3188-41b3-a6f4-9b248b8f24b5 tempest-VolumesSnapshotsTestJSON-330653950 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc is being set with open permissions: ugo+rw Apr 15 20:05:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-bc931f1e-e8db-4b57-bc12-66723f21e450 req-9c11b552-3188-41b3-a6f4-9b248b8f24b5 tempest-VolumesSnapshotsTestJSON-330653950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:32 devstack sudo[83815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc Apr 15 20:05:32 devstack sudo[83815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:32 devstack sudo[83802]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.477s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:32 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:05:32 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] Deleted volume successfully. Apr 15 20:05:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-eb4a448a-e2db-45e6-9220-567c55618366 tempest-VolumesAdminNegativeTest-525853204 None] Lock "cinder-e423feff-1c9f-4d9f-8af1-fbdb1ffba078-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:05:32 devstack sudo[83813]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-931be88f-8bc1-4452-9ac3-d508cc6be347 tempest-GroupsTest-1845340366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-46cc59c7-037a-4001-ace0-a08bec9ecf89" returned: 0 in 0.469s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-931be88f-8bc1-4452-9ac3-d508cc6be347 tempest-GroupsTest-1845340366 None] Lock "cinder-quobyte-46cc59c7-037a-4001-ace0-a08bec9ecf89" released by "delete_volume" :: held 0.994s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:05:32 devstack sudo[83815]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-bc931f1e-e8db-4b57-bc12-66723f21e450 req-9c11b552-3188-41b3-a6f4-9b248b8f24b5 tempest-VolumesSnapshotsTestJSON-330653950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc" returned: 0 in 0.480s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-bc931f1e-e8db-4b57-bc12-66723f21e450 req-9c11b552-3188-41b3-a6f4-9b248b8f24b5 tempest-VolumesSnapshotsTestJSON-330653950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:33 devstack sudo[83824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.info Apr 15 20:05:33 devstack sudo[83824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:33 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-931be88f-8bc1-4452-9ac3-d508cc6be347 tempest-GroupsTest-1845340366 None] Created reservations ['7d25d097-bb54-4004-94ce-ab61a7bbff73'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:05:33 devstack cinder-volume[82989]: WARNING cinder.quota [None req-931be88f-8bc1-4452-9ac3-d508cc6be347 tempest-GroupsTest-1845340366 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1270064128 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1270064128, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:05:33 devstack cinder-volume[82989]: WARNING cinder.quota [None req-931be88f-8bc1-4452-9ac3-d508cc6be347 tempest-GroupsTest-1845340366 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1270064128 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1270064128, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:05:33 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-931be88f-8bc1-4452-9ac3-d508cc6be347 tempest-GroupsTest-1845340366 None] Created reservations ['fd8f5850-d31b-47ed-8110-b3a8ae17ffa5', '11df981a-2ee4-449c-b312-62e91e33ef2d', 'f4eea407-fa11-42b0-9833-a7d9ff79118a', 'd7509456-61b8-433b-b6b7-2d3301d55130'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:05:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-931be88f-8bc1-4452-9ac3-d508cc6be347 tempest-GroupsTest-1845340366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:05:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-931be88f-8bc1-4452-9ac3-d508cc6be347 tempest-GroupsTest-1845340366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:05:33 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-931be88f-8bc1-4452-9ac3-d508cc6be347 tempest-GroupsTest-1845340366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:05:33 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-931be88f-8bc1-4452-9ac3-d508cc6be347 tempest-GroupsTest-1845340366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:05:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-931be88f-8bc1-4452-9ac3-d508cc6be347 tempest-GroupsTest-1845340366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:05:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-931be88f-8bc1-4452-9ac3-d508cc6be347 tempest-GroupsTest-1845340366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:33 devstack sudo[83828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:05:33 devstack sudo[83828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:33 devstack sudo[83828]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-931be88f-8bc1-4452-9ac3-d508cc6be347 tempest-GroupsTest-1845340366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.560s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:33 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-931be88f-8bc1-4452-9ac3-d508cc6be347 tempest-GroupsTest-1845340366 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:05:33 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-931be88f-8bc1-4452-9ac3-d508cc6be347 tempest-GroupsTest-1845340366 None] Delete group completed successfully. Apr 15 20:05:33 devstack sudo[83824]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-bc931f1e-e8db-4b57-bc12-66723f21e450 req-9c11b552-3188-41b3-a6f4-9b248b8f24b5 tempest-VolumesSnapshotsTestJSON-330653950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.info" returned: 0 in 0.830s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:33 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [req-bc931f1e-e8db-4b57-bc12-66723f21e450 req-9c11b552-3188-41b3-a6f4-9b248b8f24b5 tempest-VolumesSnapshotsTestJSON-330653950 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.info is being set with open permissions: ugo+rw Apr 15 20:05:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-bc931f1e-e8db-4b57-bc12-66723f21e450 req-9c11b552-3188-41b3-a6f4-9b248b8f24b5 tempest-VolumesSnapshotsTestJSON-330653950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:33 devstack sudo[83860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.info Apr 15 20:05:33 devstack sudo[83860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:34 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-025b10f3-9dc1-4c2a-84c9-03894a17098c tempest-GroupsTest-1845340366 None] Created reservations ['9cae800b-a4cb-4b25-b91f-3930e1418f0d'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:05:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-025b10f3-9dc1-4c2a-84c9-03894a17098c tempest-GroupsTest-1845340366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:05:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-025b10f3-9dc1-4c2a-84c9-03894a17098c tempest-GroupsTest-1845340366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:05:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-025b10f3-9dc1-4c2a-84c9-03894a17098c tempest-GroupsTest-1845340366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:05:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-025b10f3-9dc1-4c2a-84c9-03894a17098c tempest-GroupsTest-1845340366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:05:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-025b10f3-9dc1-4c2a-84c9-03894a17098c tempest-GroupsTest-1845340366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:05:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-025b10f3-9dc1-4c2a-84c9-03894a17098c tempest-GroupsTest-1845340366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:34 devstack sudo[83860]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:34 devstack sudo[83890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:05:34 devstack sudo[83890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-bc931f1e-e8db-4b57-bc12-66723f21e450 req-9c11b552-3188-41b3-a6f4-9b248b8f24b5 tempest-VolumesSnapshotsTestJSON-330653950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.info" returned: 0 in 0.653s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-bc931f1e-e8db-4b57-bc12-66723f21e450 req-9c11b552-3188-41b3-a6f4-9b248b8f24b5 tempest-VolumesSnapshotsTestJSON-330653950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.147s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:05:34 devstack cinder-volume[82989]: INFO cinder.volume.manager [req-bc931f1e-e8db-4b57-bc12-66723f21e450 req-9c11b552-3188-41b3-a6f4-9b248b8f24b5 tempest-VolumesSnapshotsTestJSON-330653950 None] Create snapshot completed successfully Apr 15 20:05:34 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-2b2dfe72-6063-4526-887f-48131e72cbee req-062994e2-54bf-404d-beb9-ef3a0c97c338 tempest-VolumesSnapshotsTestJSON-330653950 None] Acquiring lock "cinder-e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:05:34 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-2b2dfe72-6063-4526-887f-48131e72cbee req-062994e2-54bf-404d-beb9-ef3a0c97c338 tempest-VolumesSnapshotsTestJSON-330653950 None] Lock "cinder-e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:05:34 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-2b2dfe72-6063-4526-887f-48131e72cbee req-062994e2-54bf-404d-beb9-ef3a0c97c338 tempest-VolumesSnapshotsTestJSON-330653950 None] Acquiring lock "cinder-quobyte-6238198e-cf59-4cef-ba4e-62e3e5b75f6a" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:05:34 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-2b2dfe72-6063-4526-887f-48131e72cbee req-062994e2-54bf-404d-beb9-ef3a0c97c338 tempest-VolumesSnapshotsTestJSON-330653950 None] Lock "cinder-quobyte-6238198e-cf59-4cef-ba4e-62e3e5b75f6a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:05:34 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-2b2dfe72-6063-4526-887f-48131e72cbee req-062994e2-54bf-404d-beb9-ef3a0c97c338 tempest-VolumesSnapshotsTestJSON-330653950 None] Acquiring lock "cinder-quobyte-e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:05:34 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-2b2dfe72-6063-4526-887f-48131e72cbee req-062994e2-54bf-404d-beb9-ef3a0c97c338 tempest-VolumesSnapshotsTestJSON-330653950 None] Lock "cinder-quobyte-e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:05:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [req-2b2dfe72-6063-4526-887f-48131e72cbee req-062994e2-54bf-404d-beb9-ef3a0c97c338 tempest-VolumesSnapshotsTestJSON-330653950 None] Deleting offline snapshot e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc of volume 6238198e-cf59-4cef-ba4e-62e3e5b75f6a {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:05:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [req-2b2dfe72-6063-4526-887f-48131e72cbee req-062994e2-54bf-404d-beb9-ef3a0c97c338 tempest-VolumesSnapshotsTestJSON-330653950 None] snapshot_file for this snap is: volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:05:34 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8ff377-3e23-4b5b-9b94-62369182f906]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:05:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-2b2dfe72-6063-4526-887f-48131e72cbee req-062994e2-54bf-404d-beb9-ef3a0c97c338 tempest-VolumesSnapshotsTestJSON-330653950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:35 devstack sudo[83895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc Apr 15 20:05:35 devstack sudo[83895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:35 devstack sudo[83890]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-025b10f3-9dc1-4c2a-84c9-03894a17098c tempest-GroupsTest-1845340366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.664s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:35 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-025b10f3-9dc1-4c2a-84c9-03894a17098c tempest-GroupsTest-1845340366 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:05:35 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-025b10f3-9dc1-4c2a-84c9-03894a17098c tempest-GroupsTest-1845340366 None] Delete group completed successfully. Apr 15 20:05:35 devstack sudo[83895]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-2b2dfe72-6063-4526-887f-48131e72cbee req-062994e2-54bf-404d-beb9-ef3a0c97c338 tempest-VolumesSnapshotsTestJSON-330653950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc" returned: 0 in 0.568s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:35 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [req-2b2dfe72-6063-4526-887f-48131e72cbee req-062994e2-54bf-404d-beb9-ef3a0c97c338 tempest-VolumesSnapshotsTestJSON-330653950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:05:35 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[c801bbaa-4de2-40b5-a2a8-966dfb21de05]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:05:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-2b2dfe72-6063-4526-887f-48131e72cbee req-062994e2-54bf-404d-beb9-ef3a0c97c338 tempest-VolumesSnapshotsTestJSON-330653950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:35 devstack sudo[83907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a Apr 15 20:05:35 devstack sudo[83907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:36 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-58eac7a9-f65e-4365-ac8b-7d0d1b391d25 tempest-GroupsTest-1845340366 None] Group tempest-GroupsTest-Group-609266073: creating Apr 15 20:05:36 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-58eac7a9-f65e-4365-ac8b-7d0d1b391d25 tempest-GroupsTest-1845340366 None] Group tempest-GroupsTest-Group-609266073: created successfully Apr 15 20:05:36 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-58eac7a9-f65e-4365-ac8b-7d0d1b391d25 tempest-GroupsTest-1845340366 None] Create group completed successfully. Apr 15 20:05:36 devstack sudo[83907]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-2b2dfe72-6063-4526-887f-48131e72cbee req-062994e2-54bf-404d-beb9-ef3a0c97c338 tempest-VolumesSnapshotsTestJSON-330653950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a" returned: 0 in 0.864s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-2b2dfe72-6063-4526-887f-48131e72cbee req-062994e2-54bf-404d-beb9-ef3a0c97c338 tempest-VolumesSnapshotsTestJSON-330653950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:36 devstack sudo[83918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc Apr 15 20:05:36 devstack sudo[83918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:36 devstack sudo[83918]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-2b2dfe72-6063-4526-887f-48131e72cbee req-062994e2-54bf-404d-beb9-ef3a0c97c338 tempest-VolumesSnapshotsTestJSON-330653950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc" returned: 0 in 0.473s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-2b2dfe72-6063-4526-887f-48131e72cbee req-062994e2-54bf-404d-beb9-ef3a0c97c338 tempest-VolumesSnapshotsTestJSON-330653950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:36 devstack sudo[83925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc Apr 15 20:05:36 devstack sudo[83925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Flow 'volume_create_manager' (922abfec-ce04-4833-a321-fe8726bd663d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221b11e0-ddd6-455f-8c08-57dce282951b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:37 devstack sudo[83925]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221b11e0-ddd6-455f-8c08-57dce282951b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1574084713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cc20a865-8e96-4fee-b2b4-8cf7ba7366b5,host='devstack@QuobyteHD#QuobyteHD',id=bd4c05ad-330c-4e70-97bc-81d6188c2920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa462b9de55439c8782a4f7210b9545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:05:37Z,use_quota=True,user_id='c7d3734f72774cc0b64ce6b9a40e1254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f91aa454-04d9-4bf7-b7c7-95d076d40e12),volume_type_id=f91aa454-04d9-4bf7-b7c7-95d076d40e12)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2571860-1af9-4c64-be5f-82629061232c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2571860-1af9-4c64-be5f-82629061232c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb8f909-4195-41f4-be9c-6b305b41a46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb8f909-4195-41f4-be9c-6b305b41a46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd4c05ad-330c-4e70-97bc-81d6188c2920', 'volume_name': 'volume-bd4c05ad-330c-4e70-97bc-81d6188c2920', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a296b55e-4302-459d-9fc5-e59ea6965b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a296b55e-4302-459d-9fc5-e59ea6965b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d57fd0-a0f4-4e46-959f-61d185e4c784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:37 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Volume bd4c05ad-330c-4e70-97bc-81d6188c2920: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd4c05ad-330c-4e70-97bc-81d6188c2920', 'volume_size': 1} Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cc20a865-8e96-4fee-b2b4-8cf7ba7366b5,created_at=2026-04-15T18:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1574084713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cc20a865-8e96-4fee-b2b4-8cf7ba7366b5,host='devstack@QuobyteHD#QuobyteHD',id=bd4c05ad-330c-4e70-97bc-81d6188c2920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa462b9de55439c8782a4f7210b9545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:05:37Z,use_quota=True,user_id='c7d3734f72774cc0b64ce6b9a40e1254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f91aa454-04d9-4bf7-b7c7-95d076d40e12),volume_type_id=f91aa454-04d9-4bf7-b7c7-95d076d40e12)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Creating volume bd4c05ad-330c-4e70-97bc-81d6188c2920 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:05:37 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bd4c05ad-330c-4e70-97bc-81d6188c2920 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-2b2dfe72-6063-4526-887f-48131e72cbee req-062994e2-54bf-404d-beb9-ef3a0c97c338 tempest-VolumesSnapshotsTestJSON-330653950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a.e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc" returned: 0 in 0.623s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:37 devstack sudo[83928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bd4c05ad-330c-4e70-97bc-81d6188c2920 1073741824 Apr 15 20:05:37 devstack sudo[83928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-2b2dfe72-6063-4526-887f-48131e72cbee req-062994e2-54bf-404d-beb9-ef3a0c97c338 tempest-VolumesSnapshotsTestJSON-330653950 None] Lock "cinder-quobyte-e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc" released by "_delete_snapshot" :: held 2.633s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-2b2dfe72-6063-4526-887f-48131e72cbee req-062994e2-54bf-404d-beb9-ef3a0c97c338 tempest-VolumesSnapshotsTestJSON-330653950 None] Lock "cinder-quobyte-6238198e-cf59-4cef-ba4e-62e3e5b75f6a" released by "delete_snapshot" :: held 2.662s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:05:37 devstack cinder-volume[82989]: WARNING cinder.quota [req-2b2dfe72-6063-4526-887f-48131e72cbee req-062994e2-54bf-404d-beb9-ef3a0c97c338 tempest-VolumesSnapshotsTestJSON-330653950 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG cinder.quota [req-2b2dfe72-6063-4526-887f-48131e72cbee req-062994e2-54bf-404d-beb9-ef3a0c97c338 tempest-VolumesSnapshotsTestJSON-330653950 None] Created reservations ['48a4480d-db3b-4a6d-82c6-123e25916002', 'b0b83b05-d93c-4e3a-a609-93fcf9320d4f', '50ba0f36-131f-49f8-a827-2cb7086ca9a4', '848da9bc-b496-401c-b11d-568e0225e544'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:05:37 devstack cinder-volume[82989]: INFO cinder.volume.manager [req-2b2dfe72-6063-4526-887f-48131e72cbee req-062994e2-54bf-404d-beb9-ef3a0c97c338 tempest-VolumesSnapshotsTestJSON-330653950 None] Delete snapshot completed successfully. Apr 15 20:05:37 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-2b2dfe72-6063-4526-887f-48131e72cbee req-062994e2-54bf-404d-beb9-ef3a0c97c338 tempest-VolumesSnapshotsTestJSON-330653950 None] Lock "cinder-e8cb8e55-bffa-43ff-9bcf-3394d48f8fdc-delete_snapshot" released by "delete_snapshot" :: held 2.757s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:05:38 devstack sudo[83928]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bd4c05ad-330c-4e70-97bc-81d6188c2920 1073741824" returned: 0 in 0.555s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bd4c05ad-330c-4e70-97bc-81d6188c2920 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:38 devstack sudo[83935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bd4c05ad-330c-4e70-97bc-81d6188c2920 Apr 15 20:05:38 devstack sudo[83935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:38 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-491542e0-f017-4309-88f6-65ccca48b841 req-5cb39a21-d041-41b7-92f2-91490c26826e tempest-VolumesSnapshotsTestJSON-330653950 None] Acquiring lock "cinder-6238198e-cf59-4cef-ba4e-62e3e5b75f6a-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:05:38 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-491542e0-f017-4309-88f6-65ccca48b841 req-5cb39a21-d041-41b7-92f2-91490c26826e tempest-VolumesSnapshotsTestJSON-330653950 None] Lock "cinder-6238198e-cf59-4cef-ba4e-62e3e5b75f6a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:05:38 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-491542e0-f017-4309-88f6-65ccca48b841 req-5cb39a21-d041-41b7-92f2-91490c26826e tempest-VolumesSnapshotsTestJSON-330653950 None] Acquiring lock "cinder-quobyte-6238198e-cf59-4cef-ba4e-62e3e5b75f6a" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:05:38 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-491542e0-f017-4309-88f6-65ccca48b841 req-5cb39a21-d041-41b7-92f2-91490c26826e tempest-VolumesSnapshotsTestJSON-330653950 None] Lock "cinder-quobyte-6238198e-cf59-4cef-ba4e-62e3e5b75f6a" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:05:38 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e9a165-5da6-4318-b694-1ca98290fb43]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:05:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-491542e0-f017-4309-88f6-65ccca48b841 req-5cb39a21-d041-41b7-92f2-91490c26826e tempest-VolumesSnapshotsTestJSON-330653950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:38 devstack sudo[83937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a Apr 15 20:05:38 devstack sudo[83937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:38 devstack sudo[83935]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bd4c05ad-330c-4e70-97bc-81d6188c2920" returned: 0 in 0.541s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:38 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:05:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:05:38 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d57fd0-a0f4-4e46-959f-61d185e4c784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd4c05ad-330c-4e70-97bc-81d6188c2920', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:38 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf202a4-da7a-45ea-94b3-b53da61aab5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:38 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Volume volume-bd4c05ad-330c-4e70-97bc-81d6188c2920 (bd4c05ad-330c-4e70-97bc-81d6188c2920): created successfully Apr 15 20:05:38 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf202a4-da7a-45ea-94b3-b53da61aab5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:38 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Flow 'volume_create_manager' (922abfec-ce04-4833-a321-fe8726bd663d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:05:38 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-9cd8e712-bae8-4941-8f73-aa07e7a4c905 tempest-GroupsTest-1845340366 None] Created volume successfully. Apr 15 20:05:38 devstack sudo[83937]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-491542e0-f017-4309-88f6-65ccca48b841 req-5cb39a21-d041-41b7-92f2-91490c26826e tempest-VolumesSnapshotsTestJSON-330653950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a" returned: 0 in 0.543s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-491542e0-f017-4309-88f6-65ccca48b841 req-5cb39a21-d041-41b7-92f2-91490c26826e tempest-VolumesSnapshotsTestJSON-330653950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:38 devstack sudo[83943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a Apr 15 20:05:38 devstack sudo[83943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:39 devstack sudo[83943]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-491542e0-f017-4309-88f6-65ccca48b841 req-5cb39a21-d041-41b7-92f2-91490c26826e tempest-VolumesSnapshotsTestJSON-330653950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6238198e-cf59-4cef-ba4e-62e3e5b75f6a" returned: 0 in 0.428s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-491542e0-f017-4309-88f6-65ccca48b841 req-5cb39a21-d041-41b7-92f2-91490c26826e tempest-VolumesSnapshotsTestJSON-330653950 None] Lock "cinder-quobyte-6238198e-cf59-4cef-ba4e-62e3e5b75f6a" released by "delete_volume" :: held 1.015s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:05:39 devstack cinder-volume[82989]: DEBUG cinder.quota [req-491542e0-f017-4309-88f6-65ccca48b841 req-5cb39a21-d041-41b7-92f2-91490c26826e tempest-VolumesSnapshotsTestJSON-330653950 None] Created reservations ['19e6c985-d1f7-4e40-9d0d-bc622365d8a8', 'b0e3e2df-885a-4924-a53a-eb40aff92c34', 'd262e312-c69f-4fdd-b308-8f93f0ed63b0', '0492b7cc-fcf2-48e7-9111-9758c617337e'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:05:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-491542e0-f017-4309-88f6-65ccca48b841 req-5cb39a21-d041-41b7-92f2-91490c26826e tempest-VolumesSnapshotsTestJSON-330653950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:05:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-491542e0-f017-4309-88f6-65ccca48b841 req-5cb39a21-d041-41b7-92f2-91490c26826e tempest-VolumesSnapshotsTestJSON-330653950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:05:39 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-491542e0-f017-4309-88f6-65ccca48b841 req-5cb39a21-d041-41b7-92f2-91490c26826e tempest-VolumesSnapshotsTestJSON-330653950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:05:39 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-491542e0-f017-4309-88f6-65ccca48b841 req-5cb39a21-d041-41b7-92f2-91490c26826e tempest-VolumesSnapshotsTestJSON-330653950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:05:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-491542e0-f017-4309-88f6-65ccca48b841 req-5cb39a21-d041-41b7-92f2-91490c26826e tempest-VolumesSnapshotsTestJSON-330653950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:05:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-491542e0-f017-4309-88f6-65ccca48b841 req-5cb39a21-d041-41b7-92f2-91490c26826e tempest-VolumesSnapshotsTestJSON-330653950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:39 devstack sudo[83946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:05:39 devstack sudo[83946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:39 devstack sudo[83946]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-491542e0-f017-4309-88f6-65ccca48b841 req-5cb39a21-d041-41b7-92f2-91490c26826e tempest-VolumesSnapshotsTestJSON-330653950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.472s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:39 devstack cinder-volume[82989]: DEBUG cinder.manager [req-491542e0-f017-4309-88f6-65ccca48b841 req-5cb39a21-d041-41b7-92f2-91490c26826e tempest-VolumesSnapshotsTestJSON-330653950 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:05:39 devstack cinder-volume[82989]: INFO cinder.volume.manager [req-491542e0-f017-4309-88f6-65ccca48b841 req-5cb39a21-d041-41b7-92f2-91490c26826e tempest-VolumesSnapshotsTestJSON-330653950 None] Deleted volume successfully. Apr 15 20:05:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-491542e0-f017-4309-88f6-65ccca48b841 req-5cb39a21-d041-41b7-92f2-91490c26826e tempest-VolumesSnapshotsTestJSON-330653950 None] Lock "cinder-6238198e-cf59-4cef-ba4e-62e3e5b75f6a-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Flow 'volume_create_manager' (6efe01dd-d18a-450d-9ca6-5e6af0d71c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0614c61e-d58c-4469-8d5c-7460f40dd96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0614c61e-d58c-4469-8d5c-7460f40dd96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1192253555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cc20a865-8e96-4fee-b2b4-8cf7ba7366b5,host='devstack@QuobyteHD#QuobyteHD',id=0cdf0387-e7d0-490f-a698-3b37c0c7a57d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa462b9de55439c8782a4f7210b9545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:05:40Z,use_quota=True,user_id='c7d3734f72774cc0b64ce6b9a40e1254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f91aa454-04d9-4bf7-b7c7-95d076d40e12),volume_type_id=f91aa454-04d9-4bf7-b7c7-95d076d40e12)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c27acae-3452-4fa6-babf-01806b47accc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c27acae-3452-4fa6-babf-01806b47accc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025f3bd6-83b9-4334-8723-4fbd6aa4c39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025f3bd6-83b9-4334-8723-4fbd6aa4c39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cdf0387-e7d0-490f-a698-3b37c0c7a57d', 'volume_name': 'volume-0cdf0387-e7d0-490f-a698-3b37c0c7a57d', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf82f21c-42d3-47b7-9aa1-7d07c7bc13f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf82f21c-42d3-47b7-9aa1-7d07c7bc13f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb73ca95-ca60-4fee-a8a5-ae88b6f8d48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:40 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Volume 0cdf0387-e7d0-490f-a698-3b37c0c7a57d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cdf0387-e7d0-490f-a698-3b37c0c7a57d', 'volume_size': 1} Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cc20a865-8e96-4fee-b2b4-8cf7ba7366b5,created_at=2026-04-15T18:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1192253555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cc20a865-8e96-4fee-b2b4-8cf7ba7366b5,host='devstack@QuobyteHD#QuobyteHD',id=0cdf0387-e7d0-490f-a698-3b37c0c7a57d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa462b9de55439c8782a4f7210b9545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:05:40Z,use_quota=True,user_id='c7d3734f72774cc0b64ce6b9a40e1254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f91aa454-04d9-4bf7-b7c7-95d076d40e12),volume_type_id=f91aa454-04d9-4bf7-b7c7-95d076d40e12)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Creating volume 0cdf0387-e7d0-490f-a698-3b37c0c7a57d {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:05:40 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0cdf0387-e7d0-490f-a698-3b37c0c7a57d 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:40 devstack sudo[83954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0cdf0387-e7d0-490f-a698-3b37c0c7a57d 1073741824 Apr 15 20:05:40 devstack sudo[83954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:40 devstack sudo[83954]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0cdf0387-e7d0-490f-a698-3b37c0c7a57d 1073741824" returned: 0 in 0.790s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0cdf0387-e7d0-490f-a698-3b37c0c7a57d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:41 devstack sudo[83984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0cdf0387-e7d0-490f-a698-3b37c0c7a57d Apr 15 20:05:41 devstack sudo[83984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:41 devstack sudo[83984]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0cdf0387-e7d0-490f-a698-3b37c0c7a57d" returned: 0 in 0.677s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:41 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:05:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:05:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb73ca95-ca60-4fee-a8a5-ae88b6f8d48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cdf0387-e7d0-490f-a698-3b37c0c7a57d', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0b5036-7e7d-4313-8cc0-f68a1b2def48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:41 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Volume volume-0cdf0387-e7d0-490f-a698-3b37c0c7a57d (0cdf0387-e7d0-490f-a698-3b37c0c7a57d): created successfully Apr 15 20:05:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0b5036-7e7d-4313-8cc0-f68a1b2def48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Flow 'volume_create_manager' (6efe01dd-d18a-450d-9ca6-5e6af0d71c7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:05:41 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-65d57818-bfb1-44b5-9b30-2e4905acf093 tempest-GroupsTest-1845340366 None] Created volume successfully. Apr 15 20:05:42 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-be14a4a7-3e2a-46a6-aaf3-e30e2a3dde2e tempest-GroupsTest-1845340366 None] Update group completed successfully. Apr 15 20:05:43 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-1ec0088a-8c5c-4e35-8c4a-ae976ca6e68e tempest-GroupsTest-1845340366 None] Update group completed successfully. Apr 15 20:05:45 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] Acquiring lock "cinder-quobyte-0cdf0387-e7d0-490f-a698-3b37c0c7a57d" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:05:45 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] Lock "cinder-quobyte-0cdf0387-e7d0-490f-a698-3b37c0c7a57d" acquired by "delete_volume" :: waited 0.032s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:05:45 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13f9e6c-0580-43be-937e-af5ccd28c9b5]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:05:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0cdf0387-e7d0-490f-a698-3b37c0c7a57d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:45 devstack sudo[83995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0cdf0387-e7d0-490f-a698-3b37c0c7a57d Apr 15 20:05:45 devstack sudo[83995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:46 devstack sudo[83995]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0cdf0387-e7d0-490f-a698-3b37c0c7a57d" returned: 0 in 0.768s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0cdf0387-e7d0-490f-a698-3b37c0c7a57d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:46 devstack sudo[84002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0cdf0387-e7d0-490f-a698-3b37c0c7a57d Apr 15 20:05:46 devstack sudo[84002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:47 devstack sudo[84002]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0cdf0387-e7d0-490f-a698-3b37c0c7a57d" returned: 0 in 0.697s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:47 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] Lock "cinder-quobyte-0cdf0387-e7d0-490f-a698-3b37c0c7a57d" released by "delete_volume" :: held 1.499s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:05:47 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] Acquiring lock "cinder-quobyte-bd4c05ad-330c-4e70-97bc-81d6188c2920" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:05:47 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] Lock "cinder-quobyte-bd4c05ad-330c-4e70-97bc-81d6188c2920" acquired by "delete_volume" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:05:47 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[997aad46-a6ec-4a1b-b1ea-4c211636523c]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:05:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bd4c05ad-330c-4e70-97bc-81d6188c2920 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:47 devstack sudo[84007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bd4c05ad-330c-4e70-97bc-81d6188c2920 Apr 15 20:05:47 devstack sudo[84007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:47 devstack sudo[84007]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bd4c05ad-330c-4e70-97bc-81d6188c2920" returned: 0 in 0.725s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bd4c05ad-330c-4e70-97bc-81d6188c2920 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:47 devstack sudo[84013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bd4c05ad-330c-4e70-97bc-81d6188c2920 Apr 15 20:05:47 devstack sudo[84013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:48 devstack sudo[84013]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bd4c05ad-330c-4e70-97bc-81d6188c2920" returned: 0 in 0.568s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:48 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] Lock "cinder-quobyte-bd4c05ad-330c-4e70-97bc-81d6188c2920" released by "delete_volume" :: held 1.350s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:05:48 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] Created reservations ['f89a735e-dcfe-433f-97a7-75c72cc0cf14'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:05:48 devstack cinder-volume[82989]: WARNING cinder.quota [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-403195797 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-403195797, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:05:48 devstack cinder-volume[82989]: WARNING cinder.quota [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-403195797 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-403195797, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:05:48 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] Created reservations ['38f957ff-c40c-4787-a599-cc12f449dd20', 'dd4386e6-26b8-49fc-9c39-625edc0b43e4', '99102900-c0e0-46ed-872f-dae96442f51c', '81dbf48e-23f1-4f75-8b37-507141a6d60a'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:05:48 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] Created reservations ['0e38ec23-4d5d-4b8d-8868-00156b66c62f', '16ed93a3-1a45-4f3a-a5c8-403aee246179', '07bb90f8-dc25-477c-810b-6d57a4d44949', '55d4a45c-7a12-4a0d-a081-bffa02ba9c61'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:05:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:05:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:05:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:05:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:05:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:05:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:48 devstack sudo[84017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:05:48 devstack sudo[84017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:49 devstack sudo[84017]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.905s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:49 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:05:49 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-ab822cd4-a4b4-46ad-b0d1-b02a72418e80 tempest-GroupsTest-1845340366 None] Delete group completed successfully. Apr 15 20:05:52 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:05:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Flow 'volume_create_manager' (33039326-0a50-4ce3-978b-3aeec90862c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:05:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081c1f8d-9ffc-4491-8204-842461887bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081c1f8d-9ffc-4491-8204-842461887bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:05:52Z,deleted=False,deleted_at=None,display_description='',display_name='77d98d18-2636-4d49-9bab-96b14b4f940a-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1158390f-3495-4599-8c27-213e61b83aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce1504bdbfbd49b88236832fd7fa8bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:05:52Z,use_quota=True,user_id='7d5c23daf26d48eb8d0888573d01df30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38dbdadb-8526-4f9d-a34b-afefa47bf939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38dbdadb-8526-4f9d-a34b-afefa47bf939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff5b77a-466c-4c79-9bdc-b398074ec1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff5b77a-466c-4c79-9bdc-b398074ec1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1158390f-3495-4599-8c27-213e61b83aa8', 'volume_name': 'volume-1158390f-3495-4599-8c27-213e61b83aa8', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c03b99-7ac0-447b-9079-3f76cd737743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c03b99-7ac0-447b-9079-3f76cd737743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d07f9b8-b45a-4046-ad98-88c082989673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:52 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Volume 1158390f-3495-4599-8c27-213e61b83aa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1158390f-3495-4599-8c27-213e61b83aa8', 'volume_size': 1} Apr 15 20:05:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:05:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:05:52 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:05:52Z,deleted=False,deleted_at=None,display_description='',display_name='77d98d18-2636-4d49-9bab-96b14b4f940a-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1158390f-3495-4599-8c27-213e61b83aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce1504bdbfbd49b88236832fd7fa8bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:05:52Z,use_quota=True,user_id='7d5c23daf26d48eb8d0888573d01df30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:05:52 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Creating volume 1158390f-3495-4599-8c27-213e61b83aa8 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:05:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:05:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:05:52 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:05:52 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:05:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:05:52 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:05:52 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:05:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1158390f-3495-4599-8c27-213e61b83aa8 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:52 devstack sudo[84025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1158390f-3495-4599-8c27-213e61b83aa8 1073741824 Apr 15 20:05:52 devstack sudo[84025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:53 devstack sudo[84025]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1158390f-3495-4599-8c27-213e61b83aa8 1073741824" returned: 0 in 0.741s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1158390f-3495-4599-8c27-213e61b83aa8 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:53 devstack sudo[84033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1158390f-3495-4599-8c27-213e61b83aa8 Apr 15 20:05:53 devstack sudo[84033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:53 devstack sudo[84033]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1158390f-3495-4599-8c27-213e61b83aa8" returned: 0 in 0.469s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:53 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:05:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:05:53 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d07f9b8-b45a-4046-ad98-88c082989673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1158390f-3495-4599-8c27-213e61b83aa8', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:53 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c2ae69-7d24-427b-932d-cc84c5f603c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:53 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Volume volume-1158390f-3495-4599-8c27-213e61b83aa8 (1158390f-3495-4599-8c27-213e61b83aa8): created successfully Apr 15 20:05:53 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c2ae69-7d24-427b-932d-cc84c5f603c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:53 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Flow 'volume_create_manager' (33039326-0a50-4ce3-978b-3aeec90862c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:05:53 devstack cinder-volume[82989]: INFO cinder.volume.manager [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-1245e6f2-0277-49ea-8e50-b969c5704931 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Created volume successfully. Apr 15 20:05:55 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-6375d206-f35d-4288-8314-9d6c26b4f9f7 tempest-GroupsV314Test-292584999 None] Group tempest-GroupsV314Test-Group-184519080: creating Apr 15 20:05:55 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-6375d206-f35d-4288-8314-9d6c26b4f9f7 tempest-GroupsV314Test-292584999 None] Group tempest-GroupsV314Test-Group-184519080: created successfully Apr 15 20:05:55 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-6375d206-f35d-4288-8314-9d6c26b4f9f7 tempest-GroupsV314Test-292584999 None] Create group completed successfully. Apr 15 20:05:56 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-5aa39eac-7555-4d56-8bc1-ed539c8f9f2b tempest-GroupsV320Test-740456000 None] Group tempest-GroupsV320Test-Group-378935649: creating Apr 15 20:05:56 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-5aa39eac-7555-4d56-8bc1-ed539c8f9f2b tempest-GroupsV320Test-740456000 None] Group tempest-GroupsV320Test-Group-378935649: created successfully Apr 15 20:05:56 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-5aa39eac-7555-4d56-8bc1-ed539c8f9f2b tempest-GroupsV320Test-740456000 None] Create group completed successfully. Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Flow 'volume_create_manager' (ef3e6d56-af9f-40b0-94d0-a1c03bf02627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8411ed0c-f576-4031-89af-2362dbbd816b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8411ed0c-f576-4031-89af-2362dbbd816b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-165280130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=689e4677-d0d8-48ac-a63f-a721a4263f47,host='devstack@QuobyteHD#QuobyteHD',id=780051b3-658f-40b0-a766-cdf546557e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cad5aa68a75242e7ae422548fa327058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:05:57Z,use_quota=True,user_id='084750d75de64509bf85527766eac134',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(686e3a07-cf0b-4cb1-87fa-bd4facf96428),volume_type_id=686e3a07-cf0b-4cb1-87fa-bd4facf96428)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4900f9de-f82d-49b5-99ca-90e136c46b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4900f9de-f82d-49b5-99ca-90e136c46b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296a8c6b-8a8f-48cb-bca4-acad0746ef13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296a8c6b-8a8f-48cb-bca4-acad0746ef13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '780051b3-658f-40b0-a766-cdf546557e12', 'volume_name': 'volume-780051b3-658f-40b0-a766-cdf546557e12', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98263e59-c6e9-4096-b00e-7c4996663f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98263e59-c6e9-4096-b00e-7c4996663f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f832595c-dfb1-4e68-af56-c57f16ca9eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:57 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Volume 780051b3-658f-40b0-a766-cdf546557e12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-780051b3-658f-40b0-a766-cdf546557e12', 'volume_size': 1} Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=689e4677-d0d8-48ac-a63f-a721a4263f47,created_at=2026-04-15T18:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-165280130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=689e4677-d0d8-48ac-a63f-a721a4263f47,host='devstack@QuobyteHD#QuobyteHD',id=780051b3-658f-40b0-a766-cdf546557e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cad5aa68a75242e7ae422548fa327058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:05:57Z,use_quota=True,user_id='084750d75de64509bf85527766eac134',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(686e3a07-cf0b-4cb1-87fa-bd4facf96428),volume_type_id=686e3a07-cf0b-4cb1-87fa-bd4facf96428)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Creating volume 780051b3-658f-40b0-a766-cdf546557e12 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:05:57 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:57 devstack cinder-volume[82989]: WARNING py.warnings [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-abf9db7e-1c87-46db-9392-c4b10ca4a639 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 15 20:05:57 devstack cinder-volume[82989]: .first() Apr 15 20:05:57 devstack cinder-volume[82989]: Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-abf9db7e-1c87-46db-9392-c4b10ca4a639 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:05:57 devstack sudo[84083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12 1073741824 Apr 15 20:05:57 devstack sudo[84083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:57 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-e2e00055-54dc-4549-822b-364ffea97041 tempest-GroupsV320Test-740456000 None] Created reservations ['64e58768-213e-4177-8069-4f128531b169'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:05:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e2e00055-54dc-4549-822b-364ffea97041 tempest-GroupsV320Test-740456000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:05:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e2e00055-54dc-4549-822b-364ffea97041 tempest-GroupsV320Test-740456000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:05:58 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e2e00055-54dc-4549-822b-364ffea97041 tempest-GroupsV320Test-740456000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:05:58 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e2e00055-54dc-4549-822b-364ffea97041 tempest-GroupsV320Test-740456000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:05:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e2e00055-54dc-4549-822b-364ffea97041 tempest-GroupsV320Test-740456000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:05:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e2e00055-54dc-4549-822b-364ffea97041 tempest-GroupsV320Test-740456000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:58 devstack sudo[84086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:05:58 devstack sudo[84086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:58 devstack sudo[84083]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12 1073741824" returned: 0 in 0.748s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:58 devstack sudo[84090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12 Apr 15 20:05:58 devstack sudo[84090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:58 devstack sudo[84086]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e2e00055-54dc-4549-822b-364ffea97041 tempest-GroupsV320Test-740456000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.546s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:58 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-e2e00055-54dc-4549-822b-364ffea97041 tempest-GroupsV320Test-740456000 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:05:58 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-e2e00055-54dc-4549-822b-364ffea97041 tempest-GroupsV320Test-740456000 None] Delete group completed successfully. Apr 15 20:05:58 devstack sudo[84090]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12" returned: 0 in 0.597s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:58 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:05:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:05:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-abf9db7e-1c87-46db-9392-c4b10ca4a639 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.355s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:05:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f832595c-dfb1-4e68-af56-c57f16ca9eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-780051b3-658f-40b0-a766-cdf546557e12', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3a3f8b-f650-47f6-b105-cf3e488a1d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:05:58 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f10ecc-d0ad-4312-b02b-a080f6bb4238]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:05:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-abf9db7e-1c87-46db-9392-c4b10ca4a639 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1158390f-3495-4599-8c27-213e61b83aa8 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:05:58 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Volume volume-780051b3-658f-40b0-a766-cdf546557e12 (780051b3-658f-40b0-a766-cdf546557e12): created successfully Apr 15 20:05:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3a3f8b-f650-47f6-b105-cf3e488a1d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:05:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Flow 'volume_create_manager' (ef3e6d56-af9f-40b0-94d0-a1c03bf02627) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:05:58 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-9933de95-ae52-463b-baaf-68d690ae1f2c tempest-GroupsV314Test-292584999 None] Created volume successfully. Apr 15 20:05:59 devstack sudo[84094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1158390f-3495-4599-8c27-213e61b83aa8 Apr 15 20:05:59 devstack sudo[84094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:05:59 devstack sudo[84094]: pam_unix(sudo:session): session closed for user root Apr 15 20:05:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-abf9db7e-1c87-46db-9392-c4b10ca4a639 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1158390f-3495-4599-8c27-213e61b83aa8" returned: 0 in 0.779s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:05:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-abf9db7e-1c87-46db-9392-c4b10ca4a639 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.803s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:05:59 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-abf9db7e-1c87-46db-9392-c4b10ca4a639 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab', 'name': 'volume-1158390f-3495-4599-8c27-213e61b83aa8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '531f8804-f726-4e4e-b616-b3b26fd0e717', 'enforce_multipath': True} {{(pid=82989) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 20:05:59 devstack cinder-volume[82989]: INFO cinder.volume.manager [req-f8df1be7-6a2a-47d9-b4f4-c25895877af1 req-abf9db7e-1c87-46db-9392-c4b10ca4a639 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] attachment_update completed successfully. Apr 15 20:06:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:00 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Cloning volume 780051b3-658f-40b0-a766-cdf546557e12 to volume 211fcc62-7454-473f-8fea-aa535c8dbffc Apr 15 20:06:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Creating offline snapshot 7ea7f50f-d719-4123-a61a-ff8a75d47801 of volume 780051b3-658f-40b0-a766-cdf546557e12 {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:06:00 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5686601-8a5e-464f-8565-86c9aedb2f95]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:06:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:00 devstack sudo[84105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12 Apr 15 20:06:00 devstack sudo[84105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:01 devstack sudo[84105]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12" returned: 0 in 0.608s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.7ea7f50f-d719-4123-a61a-ff8a75d47801 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:01 devstack sudo[84110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.7ea7f50f-d719-4123-a61a-ff8a75d47801 1G Apr 15 20:06:01 devstack sudo[84110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:02 devstack sudo[84110]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.7ea7f50f-d719-4123-a61a-ff8a75d47801 1G" returned: 0 in 0.876s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-780051b3-658f-40b0-a766-cdf546557e12 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.7ea7f50f-d719-4123-a61a-ff8a75d47801 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:02 devstack sudo[84145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-780051b3-658f-40b0-a766-cdf546557e12 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.7ea7f50f-d719-4123-a61a-ff8a75d47801 Apr 15 20:06:02 devstack sudo[84145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:03 devstack sudo[84145]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-780051b3-658f-40b0-a766-cdf546557e12 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.7ea7f50f-d719-4123-a61a-ff8a75d47801" returned: 0 in 0.940s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:03 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.7ea7f50f-d719-4123-a61a-ff8a75d47801 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 20:06:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.7ea7f50f-d719-4123-a61a-ff8a75d47801 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:03 devstack sudo[84189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.7ea7f50f-d719-4123-a61a-ff8a75d47801 Apr 15 20:06:03 devstack sudo[84189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:03 devstack sudo[84189]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.7ea7f50f-d719-4123-a61a-ff8a75d47801" returned: 0 in 0.755s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:04 devstack sudo[84195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.info Apr 15 20:06:04 devstack sudo[84195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:04 devstack sudo[84195]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.info" returned: 0 in 0.669s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:04 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 20:06:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:04 devstack sudo[84198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.info Apr 15 20:06:04 devstack sudo[84198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:05 devstack sudo[84198]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.info" returned: 0 in 1.115s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Acquiring lock "cinder-quobyte-211fcc62-7454-473f-8fea-aa535c8dbffc" by "_copy_volume_from_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:06:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Lock "cinder-quobyte-211fcc62-7454-473f-8fea-aa535c8dbffc" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:06:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] snapshot: 7ea7f50f-d719-4123-a61a-ff8a75d47801, volume: 211fcc62-7454-473f-8fea-aa535c8dbffc, {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 20:06:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:06 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:06:06 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:06:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:06 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee46d5eb-1795-4c5c-9075-07149ecdb03f]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:06:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.7ea7f50f-d719-4123-a61a-ff8a75d47801 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:06 devstack sudo[84538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.7ea7f50f-d719-4123-a61a-ff8a75d47801 Apr 15 20:06:06 devstack sudo[84538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:06 devstack sudo[84538]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.7ea7f50f-d719-4123-a61a-ff8a75d47801" returned: 0 in 0.946s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:06 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-780051b3-658f-40b0-a766-cdf546557e12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:06:06 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12 {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 20:06:06 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Creating direct copy from snapshot {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 20:06:07 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[2760381f-a8a2-4f68-867b-667f0dfc08d7]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:06:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:07 devstack sudo[84580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12 Apr 15 20:06:07 devstack sudo[84580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:07 devstack sudo[84580]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12" returned: 0 in 0.658s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:07 devstack cinder-volume[82989]: DEBUG cinder.utils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Path /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-211fcc62-7454-473f-8fea-aa535c8dbffc not found in is_blk_device check {{(pid=82989) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 20:06:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-211fcc62-7454-473f-8fea-aa535c8dbffc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:07 devstack sudo[84585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-211fcc62-7454-473f-8fea-aa535c8dbffc Apr 15 20:06:07 devstack sudo[84585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:10 devstack sudo[84585]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-211fcc62-7454-473f-8fea-aa535c8dbffc" returned: 0 in 2.903s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:10 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd99082-b9ac-44af-b5fe-56d357e4396a]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:06:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:10 devstack sudo[84623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12 Apr 15 20:06:10 devstack sudo[84623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:11 devstack sudo[84623]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12" returned: 0 in 0.742s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:11 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12, size 1024.00 MB, duration 2.90 sec, destination /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-211fcc62-7454-473f-8fea-aa535c8dbffc {{(pid=82989) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 20:06:11 devstack cinder-volume[82989]: INFO cinder.image.image_utils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Converted 1024.00 MB image at 352.58 MB/s Apr 15 20:06:11 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-211fcc62-7454-473f-8fea-aa535c8dbffc is being set with open permissions: ugo+rw: NotImplementedError Apr 15 20:06:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-211fcc62-7454-473f-8fea-aa535c8dbffc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:11 devstack sudo[84629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-211fcc62-7454-473f-8fea-aa535c8dbffc Apr 15 20:06:11 devstack sudo[84629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:11 devstack sudo[84629]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-211fcc62-7454-473f-8fea-aa535c8dbffc" returned: 0 in 0.400s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:11 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Lock "cinder-quobyte-211fcc62-7454-473f-8fea-aa535c8dbffc" released by "_copy_volume_from_snapshot" :: held 5.780s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:06:11 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Acquiring lock "cinder-quobyte-7ea7f50f-d719-4123-a61a-ff8a75d47801" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:06:11 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Lock "cinder-quobyte-7ea7f50f-d719-4123-a61a-ff8a75d47801" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:06:11 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Deleting offline snapshot 7ea7f50f-d719-4123-a61a-ff8a75d47801 of volume 780051b3-658f-40b0-a766-cdf546557e12 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:06:11 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] snapshot_file for this snap is: volume-780051b3-658f-40b0-a766-cdf546557e12.7ea7f50f-d719-4123-a61a-ff8a75d47801 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:06:11 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[855887fa-7545-4ff1-8743-70510614209d]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:06:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.7ea7f50f-d719-4123-a61a-ff8a75d47801 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:11 devstack sudo[84632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.7ea7f50f-d719-4123-a61a-ff8a75d47801 Apr 15 20:06:11 devstack sudo[84632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:12 devstack sudo[84632]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.7ea7f50f-d719-4123-a61a-ff8a75d47801" returned: 0 in 0.584s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:12 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-780051b3-658f-40b0-a766-cdf546557e12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:06:12 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5acc269-5dbc-4628-a178-8ce6d5e27721]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:06:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:12 devstack sudo[84638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12 Apr 15 20:06:12 devstack sudo[84638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:12 devstack sudo[84638]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12" returned: 0 in 0.502s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.7ea7f50f-d719-4123-a61a-ff8a75d47801 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:12 devstack sudo[84644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.7ea7f50f-d719-4123-a61a-ff8a75d47801 Apr 15 20:06:12 devstack sudo[84644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:13 devstack sudo[84644]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.7ea7f50f-d719-4123-a61a-ff8a75d47801" returned: 0 in 0.563s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.7ea7f50f-d719-4123-a61a-ff8a75d47801 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:13 devstack sudo[84649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.7ea7f50f-d719-4123-a61a-ff8a75d47801 Apr 15 20:06:13 devstack sudo[84649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:14 devstack sudo[84649]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12.7ea7f50f-d719-4123-a61a-ff8a75d47801" returned: 0 in 0.547s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:14 devstack cinder-volume[82989]: DEBUG dbcounter [-] [82989] Writing DB stats cinder:SELECT=78,cinder:UPDATE=82,cinder:INSERT=23,cinder:DELETE=2 {{(pid=82989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:06:14 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Lock "cinder-quobyte-7ea7f50f-d719-4123-a61a-ff8a75d47801" released by "_delete_snapshot" :: held 2.276s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:06:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.328s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:14 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-3e5df467-09b9-4920-9cba-f82e33eeb6c0 tempest-GroupsV314Test-292584999 None] Create group from source-group-689e4677-d0d8-48ac-a63f-a721a4263f47 completed successfully. Apr 15 20:06:14 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-54d87daf-66a3-41cf-b872-6afe93fdd095 tempest-GroupsV314Test-292584999 None] Acquiring lock "cinder-quobyte-211fcc62-7454-473f-8fea-aa535c8dbffc" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:06:14 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-54d87daf-66a3-41cf-b872-6afe93fdd095 tempest-GroupsV314Test-292584999 None] Lock "cinder-quobyte-211fcc62-7454-473f-8fea-aa535c8dbffc" acquired by "delete_volume" :: waited 0.041s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:06:14 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c1d0fe-5065-469a-9314-8b2f739c61e5]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:06:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-54d87daf-66a3-41cf-b872-6afe93fdd095 tempest-GroupsV314Test-292584999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-211fcc62-7454-473f-8fea-aa535c8dbffc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:15 devstack sudo[84674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-211fcc62-7454-473f-8fea-aa535c8dbffc Apr 15 20:06:15 devstack sudo[84674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:15 devstack sudo[84674]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-54d87daf-66a3-41cf-b872-6afe93fdd095 tempest-GroupsV314Test-292584999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-211fcc62-7454-473f-8fea-aa535c8dbffc" returned: 0 in 0.917s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-54d87daf-66a3-41cf-b872-6afe93fdd095 tempest-GroupsV314Test-292584999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-211fcc62-7454-473f-8fea-aa535c8dbffc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:15 devstack sudo[84699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-211fcc62-7454-473f-8fea-aa535c8dbffc Apr 15 20:06:15 devstack sudo[84699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:16 devstack sudo[84699]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-54d87daf-66a3-41cf-b872-6afe93fdd095 tempest-GroupsV314Test-292584999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-211fcc62-7454-473f-8fea-aa535c8dbffc" returned: 0 in 0.508s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:16 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-54d87daf-66a3-41cf-b872-6afe93fdd095 tempest-GroupsV314Test-292584999 None] Lock "cinder-quobyte-211fcc62-7454-473f-8fea-aa535c8dbffc" released by "delete_volume" :: held 1.501s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:06:16 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-54d87daf-66a3-41cf-b872-6afe93fdd095 tempest-GroupsV314Test-292584999 None] Created reservations ['07053f84-c515-4ee0-ae4e-3cb8159618fb'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:06:16 devstack cinder-volume[82989]: WARNING cinder.quota [None req-54d87daf-66a3-41cf-b872-6afe93fdd095 tempest-GroupsV314Test-292584999 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1586644596 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1586644596, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:06:16 devstack cinder-volume[82989]: WARNING cinder.quota [None req-54d87daf-66a3-41cf-b872-6afe93fdd095 tempest-GroupsV314Test-292584999 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1586644596 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1586644596, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:06:16 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-54d87daf-66a3-41cf-b872-6afe93fdd095 tempest-GroupsV314Test-292584999 None] Created reservations ['8f647a27-e324-4988-babf-1586013b7594', '79a35470-a51d-4b61-b9cc-5c153909da80', 'adf579f1-3fd0-422c-ad48-61f91d79f934', 'c97b46d0-a817-463d-9929-2e1896fa61d8'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:06:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-54d87daf-66a3-41cf-b872-6afe93fdd095 tempest-GroupsV314Test-292584999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-54d87daf-66a3-41cf-b872-6afe93fdd095 tempest-GroupsV314Test-292584999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:16 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-54d87daf-66a3-41cf-b872-6afe93fdd095 tempest-GroupsV314Test-292584999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:06:16 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-54d87daf-66a3-41cf-b872-6afe93fdd095 tempest-GroupsV314Test-292584999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:06:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-54d87daf-66a3-41cf-b872-6afe93fdd095 tempest-GroupsV314Test-292584999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-54d87daf-66a3-41cf-b872-6afe93fdd095 tempest-GroupsV314Test-292584999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:16 devstack sudo[84711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:06:16 devstack sudo[84711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:16 devstack sudo[84711]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-54d87daf-66a3-41cf-b872-6afe93fdd095 tempest-GroupsV314Test-292584999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.465s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:16 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-54d87daf-66a3-41cf-b872-6afe93fdd095 tempest-GroupsV314Test-292584999 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:06:16 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-54d87daf-66a3-41cf-b872-6afe93fdd095 tempest-GroupsV314Test-292584999 None] Delete group completed successfully. Apr 15 20:06:17 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-47dfa5ae-d17a-46b8-b84f-31efee19c914 tempest-GroupsV314Test-292584999 None] Acquiring lock "cinder-quobyte-780051b3-658f-40b0-a766-cdf546557e12" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:06:17 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-47dfa5ae-d17a-46b8-b84f-31efee19c914 tempest-GroupsV314Test-292584999 None] Lock "cinder-quobyte-780051b3-658f-40b0-a766-cdf546557e12" acquired by "delete_volume" :: waited 0.013s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:06:17 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7d8dc9-2c25-4f6a-b715-18cde957287a]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:06:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-47dfa5ae-d17a-46b8-b84f-31efee19c914 tempest-GroupsV314Test-292584999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:17 devstack sudo[84724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12 Apr 15 20:06:17 devstack sudo[84724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:17 devstack sudo[84724]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-47dfa5ae-d17a-46b8-b84f-31efee19c914 tempest-GroupsV314Test-292584999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12" returned: 0 in 0.558s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-47dfa5ae-d17a-46b8-b84f-31efee19c914 tempest-GroupsV314Test-292584999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:17 devstack sudo[84729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12 Apr 15 20:06:17 devstack sudo[84729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:18 devstack sudo[84729]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-47dfa5ae-d17a-46b8-b84f-31efee19c914 tempest-GroupsV314Test-292584999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-780051b3-658f-40b0-a766-cdf546557e12" returned: 0 in 0.475s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:18 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-47dfa5ae-d17a-46b8-b84f-31efee19c914 tempest-GroupsV314Test-292584999 None] Lock "cinder-quobyte-780051b3-658f-40b0-a766-cdf546557e12" released by "delete_volume" :: held 1.080s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:06:18 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-47dfa5ae-d17a-46b8-b84f-31efee19c914 tempest-GroupsV314Test-292584999 None] Created reservations ['3a33fa78-0e5f-46f3-ad29-5a170be67414'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:06:18 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-47dfa5ae-d17a-46b8-b84f-31efee19c914 tempest-GroupsV314Test-292584999 None] Created reservations ['22db3493-976c-4516-b305-e23bf571a2f0', '705de9a0-97bd-4b54-920c-6e3ceb4a8742', '11f17551-146c-44aa-8de7-a6b3f16e63f1', '49ceb47a-8cd9-4a36-bacf-b7902be62e59'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:06:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-47dfa5ae-d17a-46b8-b84f-31efee19c914 tempest-GroupsV314Test-292584999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-47dfa5ae-d17a-46b8-b84f-31efee19c914 tempest-GroupsV314Test-292584999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-47dfa5ae-d17a-46b8-b84f-31efee19c914 tempest-GroupsV314Test-292584999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:06:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-47dfa5ae-d17a-46b8-b84f-31efee19c914 tempest-GroupsV314Test-292584999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:06:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-47dfa5ae-d17a-46b8-b84f-31efee19c914 tempest-GroupsV314Test-292584999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-47dfa5ae-d17a-46b8-b84f-31efee19c914 tempest-GroupsV314Test-292584999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:18 devstack sudo[84739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:06:18 devstack sudo[84739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:18 devstack sudo[84739]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-47dfa5ae-d17a-46b8-b84f-31efee19c914 tempest-GroupsV314Test-292584999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.493s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:18 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-47dfa5ae-d17a-46b8-b84f-31efee19c914 tempest-GroupsV314Test-292584999 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:06:18 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-47dfa5ae-d17a-46b8-b84f-31efee19c914 tempest-GroupsV314Test-292584999 None] Delete group completed successfully. Apr 15 20:06:22 devstack cinder-volume[82989]: DEBUG dbcounter [-] [82989] Writing DB stats cinder:UPDATE=121,cinder:SELECT=123,cinder:INSERT=21,cinder:DELETE=8 {{(pid=82989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:06:22 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Flow 'volume_create_manager' (a4fb4ccc-44d9-4f7f-a704-4e77d7f04416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d31e8a5-79a9-438e-8cd9-408c9247d151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d31e8a5-79a9-438e-8cd9-408c9247d151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-332377579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f43cc18-e64c-414e-a941-244923d9ad23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='057eb53f34a64b26a7b9f59642a54735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:06:23Z,use_quota=True,user_id='075ffe38c574432cbc6b82384086c0ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5549580-1ace-4a76-88b1-c01a37d995b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5549580-1ace-4a76-88b1-c01a37d995b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c10132-924b-4650-832c-b6f2cc98b068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c10132-924b-4650-832c-b6f2cc98b068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f43cc18-e64c-414e-a941-244923d9ad23', 'volume_name': 'volume-5f43cc18-e64c-414e-a941-244923d9ad23', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ec51f7-c380-41ec-8e15-d74e53627987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ec51f7-c380-41ec-8e15-d74e53627987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faefe2c0-299c-4574-bf1a-2932fd42ee27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:23 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Volume 5f43cc18-e64c-414e-a941-244923d9ad23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f43cc18-e64c-414e-a941-244923d9ad23', 'volume_size': 1} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-332377579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f43cc18-e64c-414e-a941-244923d9ad23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='057eb53f34a64b26a7b9f59642a54735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:06:23Z,use_quota=True,user_id='075ffe38c574432cbc6b82384086c0ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Creating volume 5f43cc18-e64c-414e-a941-244923d9ad23 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:06:23 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5f43cc18-e64c-414e-a941-244923d9ad23 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:23 devstack sudo[84835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5f43cc18-e64c-414e-a941-244923d9ad23 1073741824 Apr 15 20:06:23 devstack sudo[84835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Flow 'volume_create_manager' (9701c164-3a2a-4004-9063-96e8f0904fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c88c88-b8b7-4c1d-a441-37d535bfc632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c88c88-b8b7-4c1d-a441-37d535bfc632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-698755690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9b6ce2-c75b-4b30-a861-4bcd17d6033b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e051bde12df246e9a2fbece25f0cba34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:06:23Z,use_quota=True,user_id='e23afe7b89604b38923d6fdcd9e9b20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d797970-7b0b-465d-ba37-8e9214119253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d797970-7b0b-465d-ba37-8e9214119253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a9bdea5-6ffb-4ea6-ae84-fd6ddece198c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a9bdea5-6ffb-4ea6-ae84-fd6ddece198c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a9b6ce2-c75b-4b30-a861-4bcd17d6033b', 'volume_name': 'volume-0a9b6ce2-c75b-4b30-a861-4bcd17d6033b', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9e636d-dd63-4084-b5cb-f2db61d82f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9e636d-dd63-4084-b5cb-f2db61d82f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31fc7b0-f485-46ad-ab24-a1459c659001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:23 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Volume 0a9b6ce2-c75b-4b30-a861-4bcd17d6033b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a9b6ce2-c75b-4b30-a861-4bcd17d6033b', 'volume_size': 1} Apr 15 20:06:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:24 devstack sudo[84835]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5f43cc18-e64c-414e-a941-244923d9ad23 1073741824" returned: 0 in 0.852s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5f43cc18-e64c-414e-a941-244923d9ad23 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:24 devstack sudo[84842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5f43cc18-e64c-414e-a941-244923d9ad23 Apr 15 20:06:24 devstack sudo[84842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:24 devstack sudo[84842]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5f43cc18-e64c-414e-a941-244923d9ad23" returned: 0 in 0.448s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:24 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:06:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.039s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:24 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-698755690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9b6ce2-c75b-4b30-a861-4bcd17d6033b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e051bde12df246e9a2fbece25f0cba34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:06:23Z,use_quota=True,user_id='e23afe7b89604b38923d6fdcd9e9b20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:06:24 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Creating volume 0a9b6ce2-c75b-4b30-a861-4bcd17d6033b {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:06:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:24 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:06:24 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:06:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:24 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:06:24 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:06:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0a9b6ce2-c75b-4b30-a861-4bcd17d6033b 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:24 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faefe2c0-299c-4574-bf1a-2932fd42ee27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f43cc18-e64c-414e-a941-244923d9ad23', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:24 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5406c4-874a-4f4f-9313-b5a479dbc454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:24 devstack sudo[84845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0a9b6ce2-c75b-4b30-a861-4bcd17d6033b 1073741824 Apr 15 20:06:24 devstack sudo[84845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:24 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Volume volume-5f43cc18-e64c-414e-a941-244923d9ad23 (5f43cc18-e64c-414e-a941-244923d9ad23): created successfully Apr 15 20:06:24 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5406c4-874a-4f4f-9313-b5a479dbc454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:24 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Flow 'volume_create_manager' (a4fb4ccc-44d9-4f7f-a704-4e77d7f04416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:06:24 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-5813591a-e2bb-4ae6-9a07-75a103d8b9c5 tempest-DeleteServersTestJSON-1751854506 None] Created volume successfully. Apr 15 20:06:25 devstack sudo[84845]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0a9b6ce2-c75b-4b30-a861-4bcd17d6033b 1073741824" returned: 0 in 0.677s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0a9b6ce2-c75b-4b30-a861-4bcd17d6033b {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:25 devstack sudo[84854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0a9b6ce2-c75b-4b30-a861-4bcd17d6033b Apr 15 20:06:25 devstack sudo[84854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:25 devstack sudo[84854]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0a9b6ce2-c75b-4b30-a861-4bcd17d6033b" returned: 0 in 0.435s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:25 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:06:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:25 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31fc7b0-f485-46ad-ab24-a1459c659001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a9b6ce2-c75b-4b30-a861-4bcd17d6033b', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:25 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed86628a-51b8-4c1f-ade3-e32417580fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:25 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Volume volume-0a9b6ce2-c75b-4b30-a861-4bcd17d6033b (0a9b6ce2-c75b-4b30-a861-4bcd17d6033b): created successfully Apr 15 20:06:25 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed86628a-51b8-4c1f-ade3-e32417580fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:25 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Flow 'volume_create_manager' (9701c164-3a2a-4004-9063-96e8f0904fd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:06:25 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-e7c375c2-a721-4622-8f97-3d474ec4d365 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Created volume successfully. Apr 15 20:06:26 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-19574379-f496-42f3-8f70-ca872b8f8005 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Acquiring lock "cinder-0a9b6ce2-c75b-4b30-a861-4bcd17d6033b-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:06:26 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-19574379-f496-42f3-8f70-ca872b8f8005 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Lock "cinder-0a9b6ce2-c75b-4b30-a861-4bcd17d6033b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:06:26 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-19574379-f496-42f3-8f70-ca872b8f8005 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Acquiring lock "cinder-quobyte-0a9b6ce2-c75b-4b30-a861-4bcd17d6033b" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:06:26 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-19574379-f496-42f3-8f70-ca872b8f8005 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Lock "cinder-quobyte-0a9b6ce2-c75b-4b30-a861-4bcd17d6033b" acquired by "delete_volume" :: waited 0.014s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:06:26 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[9075ab7c-329d-42cf-b4c3-6f6752d7123e]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:06:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-19574379-f496-42f3-8f70-ca872b8f8005 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0a9b6ce2-c75b-4b30-a861-4bcd17d6033b {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:26 devstack sudo[84883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0a9b6ce2-c75b-4b30-a861-4bcd17d6033b Apr 15 20:06:26 devstack sudo[84883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:27 devstack sudo[84883]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-19574379-f496-42f3-8f70-ca872b8f8005 tempest-VolumeQuotasAdminTestJSON-1080525905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0a9b6ce2-c75b-4b30-a861-4bcd17d6033b" returned: 0 in 0.654s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-19574379-f496-42f3-8f70-ca872b8f8005 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0a9b6ce2-c75b-4b30-a861-4bcd17d6033b {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:27 devstack sudo[84911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0a9b6ce2-c75b-4b30-a861-4bcd17d6033b Apr 15 20:06:27 devstack sudo[84911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:27 devstack cinder-volume[82989]: DEBUG oslo_service.periodic_task [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82989) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 20:06:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:06:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:06:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:27 devstack sudo[84913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:06:27 devstack sudo[84913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:27 devstack sudo[84911]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-19574379-f496-42f3-8f70-ca872b8f8005 tempest-VolumeQuotasAdminTestJSON-1080525905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0a9b6ce2-c75b-4b30-a861-4bcd17d6033b" returned: 0 in 0.502s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-19574379-f496-42f3-8f70-ca872b8f8005 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Lock "cinder-quobyte-0a9b6ce2-c75b-4b30-a861-4bcd17d6033b" released by "delete_volume" :: held 1.193s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:06:27 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-19574379-f496-42f3-8f70-ca872b8f8005 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Created reservations ['060baa95-76f4-46fd-ba42-2f842a40a743', '55bc3227-e7f4-4b78-8498-bb9d43e91839', '6257787e-8186-4e8a-a080-eba24dc8b955', 'ebd6eb32-a991-4066-837b-772aa9bf4757'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:06:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-19574379-f496-42f3-8f70-ca872b8f8005 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-19574379-f496-42f3-8f70-ca872b8f8005 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-19574379-f496-42f3-8f70-ca872b8f8005 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:06:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-19574379-f496-42f3-8f70-ca872b8f8005 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:06:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-19574379-f496-42f3-8f70-ca872b8f8005 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-19574379-f496-42f3-8f70-ca872b8f8005 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:27 devstack sudo[84917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:06:27 devstack sudo[84917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:28 devstack sudo[84913]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.485s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:28 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:06:28 devstack sudo[84917]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-19574379-f496-42f3-8f70-ca872b8f8005 tempest-VolumeQuotasAdminTestJSON-1080525905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.460s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:28 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-19574379-f496-42f3-8f70-ca872b8f8005 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:06:28 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-19574379-f496-42f3-8f70-ca872b8f8005 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Deleted volume successfully. Apr 15 20:06:28 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-19574379-f496-42f3-8f70-ca872b8f8005 tempest-VolumeQuotasAdminTestJSON-1080525905 None] Lock "cinder-0a9b6ce2-c75b-4b30-a861-4bcd17d6033b-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:06:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-999fb9b2-d240-472d-9272-f346ad23683b req-1873afba-9c0f-4f18-8ecc-f618e2b1e6c9 tempest-DeleteServersTestJSON-1751854506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-999fb9b2-d240-472d-9272-f346ad23683b req-1873afba-9c0f-4f18-8ecc-f618e2b1e6c9 tempest-DeleteServersTestJSON-1751854506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:28 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[8170ee2a-ef13-4530-b436-03226d20df14]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:06:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-999fb9b2-d240-472d-9272-f346ad23683b req-1873afba-9c0f-4f18-8ecc-f618e2b1e6c9 tempest-DeleteServersTestJSON-1751854506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5f43cc18-e64c-414e-a941-244923d9ad23 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:28 devstack sudo[84930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5f43cc18-e64c-414e-a941-244923d9ad23 Apr 15 20:06:28 devstack sudo[84930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Flow 'volume_create_manager' (e5a23263-5713-41b6-bbd6-b92bac2cc34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4918897e-1b34-4363-982f-035af8e87ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4918897e-1b34-4363-982f-035af8e87ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-356101174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=231a8628-c449-4500-807b-8f779e75095f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e051bde12df246e9a2fbece25f0cba34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:06:29Z,use_quota=True,user_id='e23afe7b89604b38923d6fdcd9e9b20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf216743-ee67-448b-b2de-5a8087f5ce8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf216743-ee67-448b-b2de-5a8087f5ce8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:29 devstack sudo[84930]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5498b77d-62db-4e70-8614-5f4d3186a30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5498b77d-62db-4e70-8614-5f4d3186a30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '231a8628-c449-4500-807b-8f779e75095f', 'volume_name': 'volume-231a8628-c449-4500-807b-8f779e75095f', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d7ce14-70aa-42e6-8c72-7737ade797bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d7ce14-70aa-42e6-8c72-7737ade797bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e4a0dac-c18f-4e2c-99d1-e608e3300cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:29 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Volume 231a8628-c449-4500-807b-8f779e75095f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-231a8628-c449-4500-807b-8f779e75095f', 'volume_size': 1} Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-999fb9b2-d240-472d-9272-f346ad23683b req-1873afba-9c0f-4f18-8ecc-f618e2b1e6c9 tempest-DeleteServersTestJSON-1751854506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5f43cc18-e64c-414e-a941-244923d9ad23" returned: 0 in 0.663s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-999fb9b2-d240-472d-9272-f346ad23683b req-1873afba-9c0f-4f18-8ecc-f618e2b1e6c9 tempest-DeleteServersTestJSON-1751854506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.685s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-356101174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=231a8628-c449-4500-807b-8f779e75095f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e051bde12df246e9a2fbece25f0cba34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:06:29Z,use_quota=True,user_id='e23afe7b89604b38923d6fdcd9e9b20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Creating volume 231a8628-c449-4500-807b-8f779e75095f {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:06:29 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-231a8628-c449-4500-807b-8f779e75095f 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:29 devstack sudo[84935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-231a8628-c449-4500-807b-8f779e75095f 1073741824 Apr 15 20:06:29 devstack sudo[84935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-999fb9b2-d240-472d-9272-f346ad23683b req-1873afba-9c0f-4f18-8ecc-f618e2b1e6c9 tempest-DeleteServersTestJSON-1751854506 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab', 'name': 'volume-5f43cc18-e64c-414e-a941-244923d9ad23', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e71441c0-2698-457b-ae70-90597ccbfd93', 'enforce_multipath': True} {{(pid=82989) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 20:06:29 devstack cinder-volume[82989]: INFO cinder.volume.manager [req-999fb9b2-d240-472d-9272-f346ad23683b req-1873afba-9c0f-4f18-8ecc-f618e2b1e6c9 tempest-DeleteServersTestJSON-1751854506 None] attachment_update completed successfully. Apr 15 20:06:29 devstack sudo[84935]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-231a8628-c449-4500-807b-8f779e75095f 1073741824" returned: 0 in 0.670s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-231a8628-c449-4500-807b-8f779e75095f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:29 devstack sudo[84944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-231a8628-c449-4500-807b-8f779e75095f Apr 15 20:06:29 devstack sudo[84944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:30 devstack sudo[84944]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-231a8628-c449-4500-807b-8f779e75095f" returned: 0 in 0.517s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:06:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e4a0dac-c18f-4e2c-99d1-e608e3300cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-231a8628-c449-4500-807b-8f779e75095f', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f41289a-9a9e-4e7b-9087-b061c9d0d387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:30 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Volume volume-231a8628-c449-4500-807b-8f779e75095f (231a8628-c449-4500-807b-8f779e75095f): created successfully Apr 15 20:06:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f41289a-9a9e-4e7b-9087-b061c9d0d387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Flow 'volume_create_manager' (e5a23263-5713-41b6-bbd6-b92bac2cc34f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:06:30 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-bdb4e279-3f0d-4450-9f0f-cdb7b570e4bb tempest-VolumeQuotasAdminTestJSON-1080525905 None] Created volume successfully. Apr 15 20:06:31 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-ebfe1444-cfd3-49ce-94d3-4a734ad4cfd3 tempest-VolumeQuotasAdminTestJSON-1789009115 None] Transfer volume completed successfully. Apr 15 20:06:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9d333f7f-d8fc-421e-80db-1afc01cf3d4b tempest-VolumeQuotasAdminTestJSON-2068816382 None] Acquiring lock "cinder-231a8628-c449-4500-807b-8f779e75095f-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:06:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9d333f7f-d8fc-421e-80db-1afc01cf3d4b tempest-VolumeQuotasAdminTestJSON-2068816382 None] Lock "cinder-231a8628-c449-4500-807b-8f779e75095f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:06:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9d333f7f-d8fc-421e-80db-1afc01cf3d4b tempest-VolumeQuotasAdminTestJSON-2068816382 None] Acquiring lock "cinder-quobyte-231a8628-c449-4500-807b-8f779e75095f" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:06:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9d333f7f-d8fc-421e-80db-1afc01cf3d4b tempest-VolumeQuotasAdminTestJSON-2068816382 None] Lock "cinder-quobyte-231a8628-c449-4500-807b-8f779e75095f" acquired by "delete_volume" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:06:32 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b36e3c5-9439-4979-a3ba-74764d6644b1]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:06:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9d333f7f-d8fc-421e-80db-1afc01cf3d4b tempest-VolumeQuotasAdminTestJSON-2068816382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-231a8628-c449-4500-807b-8f779e75095f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:32 devstack sudo[84968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-231a8628-c449-4500-807b-8f779e75095f Apr 15 20:06:32 devstack sudo[84968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:33 devstack sudo[84968]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9d333f7f-d8fc-421e-80db-1afc01cf3d4b tempest-VolumeQuotasAdminTestJSON-2068816382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-231a8628-c449-4500-807b-8f779e75095f" returned: 0 in 0.530s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9d333f7f-d8fc-421e-80db-1afc01cf3d4b tempest-VolumeQuotasAdminTestJSON-2068816382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-231a8628-c449-4500-807b-8f779e75095f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:33 devstack sudo[84986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-231a8628-c449-4500-807b-8f779e75095f Apr 15 20:06:33 devstack sudo[84986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:33 devstack sudo[84986]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9d333f7f-d8fc-421e-80db-1afc01cf3d4b tempest-VolumeQuotasAdminTestJSON-2068816382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-231a8628-c449-4500-807b-8f779e75095f" returned: 0 in 0.474s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9d333f7f-d8fc-421e-80db-1afc01cf3d4b tempest-VolumeQuotasAdminTestJSON-2068816382 None] Lock "cinder-quobyte-231a8628-c449-4500-807b-8f779e75095f" released by "delete_volume" :: held 1.063s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:06:33 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-9d333f7f-d8fc-421e-80db-1afc01cf3d4b tempest-VolumeQuotasAdminTestJSON-2068816382 None] Created reservations ['e1194be0-a603-4fd9-9e5f-0f79bb3d205b', 'd9530ba8-73b4-4f7b-bfcf-d489b073b600', '2826cd85-d6eb-4b8d-9ede-8a8ffbede83a', 'c658cf2f-a16b-4add-94f1-98acaf9905b2'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:06:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9d333f7f-d8fc-421e-80db-1afc01cf3d4b tempest-VolumeQuotasAdminTestJSON-2068816382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9d333f7f-d8fc-421e-80db-1afc01cf3d4b tempest-VolumeQuotasAdminTestJSON-2068816382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:33 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9d333f7f-d8fc-421e-80db-1afc01cf3d4b tempest-VolumeQuotasAdminTestJSON-2068816382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:06:33 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9d333f7f-d8fc-421e-80db-1afc01cf3d4b tempest-VolumeQuotasAdminTestJSON-2068816382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:06:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9d333f7f-d8fc-421e-80db-1afc01cf3d4b tempest-VolumeQuotasAdminTestJSON-2068816382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9d333f7f-d8fc-421e-80db-1afc01cf3d4b tempest-VolumeQuotasAdminTestJSON-2068816382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:33 devstack sudo[84989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:06:33 devstack sudo[84989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:34 devstack sudo[84989]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9d333f7f-d8fc-421e-80db-1afc01cf3d4b tempest-VolumeQuotasAdminTestJSON-2068816382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.648s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:34 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-9d333f7f-d8fc-421e-80db-1afc01cf3d4b tempest-VolumeQuotasAdminTestJSON-2068816382 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:06:34 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-9d333f7f-d8fc-421e-80db-1afc01cf3d4b tempest-VolumeQuotasAdminTestJSON-2068816382 None] Deleted volume successfully. Apr 15 20:06:34 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9d333f7f-d8fc-421e-80db-1afc01cf3d4b tempest-VolumeQuotasAdminTestJSON-2068816382 None] Lock "cinder-231a8628-c449-4500-807b-8f779e75095f-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:06:37 devstack cinder-volume[82989]: INFO cinder.volume.manager [req-83320e9b-e83b-4e23-b3ea-a52e392d02bb req-8e110226-5eb9-4b72-ba2e-b9171a37c073 tempest-DeleteServersTestJSON-1751854506 None] Terminate volume connection completed successfully. Apr 15 20:06:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-83320e9b-e83b-4e23-b3ea-a52e392d02bb req-8e110226-5eb9-4b72-ba2e-b9171a37c073 tempest-DeleteServersTestJSON-1751854506 None] Deleting attachment e71441c0-2698-457b-ae70-90597ccbfd93. {{(pid=82989) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 20:06:39 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:06:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Flow 'volume_create_manager' (66a434e2-6c26-48ca-8ddc-a5288ffbff2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:06:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9b4595-fa30-4dba-9c2d-abde7594839b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9b4595-fa30-4dba-9c2d-abde7594839b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-26783271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfc53c68-42c2-41b3-b87e-8a6cf9a118d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='912baa8395c94976b1a7df5be71dfe44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:06:40Z,use_quota=True,user_id='7410314b08a4402b9097180254fa1919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44455fd0-8cfc-447c-9c41-760cab9ee1fb),volume_type_id=44455fd0-8cfc-447c-9c41-760cab9ee1fb)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e45109-99a5-402d-99ce-242018872f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e45109-99a5-402d-99ce-242018872f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1db518-a73d-44ac-a9ec-810af929b84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1db518-a73d-44ac-a9ec-810af929b84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfc53c68-42c2-41b3-b87e-8a6cf9a118d4', 'volume_name': 'volume-bfc53c68-42c2-41b3-b87e-8a6cf9a118d4', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a913c24-eaea-47a5-b21d-78582f3a46b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a913c24-eaea-47a5-b21d-78582f3a46b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (860dfdca-2341-4a44-bcc1-c72d46c5fb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:39 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Volume bfc53c68-42c2-41b3-b87e-8a6cf9a118d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfc53c68-42c2-41b3-b87e-8a6cf9a118d4', 'volume_size': 1} Apr 15 20:06:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:39 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-26783271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfc53c68-42c2-41b3-b87e-8a6cf9a118d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='912baa8395c94976b1a7df5be71dfe44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:06:40Z,use_quota=True,user_id='7410314b08a4402b9097180254fa1919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44455fd0-8cfc-447c-9c41-760cab9ee1fb),volume_type_id=44455fd0-8cfc-447c-9c41-760cab9ee1fb)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:06:39 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Creating volume bfc53c68-42c2-41b3-b87e-8a6cf9a118d4 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:06:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:39 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:06:39 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:06:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:39 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:06:39 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:06:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bfc53c68-42c2-41b3-b87e-8a6cf9a118d4 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:40 devstack sudo[85043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bfc53c68-42c2-41b3-b87e-8a6cf9a118d4 1073741824 Apr 15 20:06:40 devstack sudo[85043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:40 devstack sudo[85043]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bfc53c68-42c2-41b3-b87e-8a6cf9a118d4 1073741824" returned: 0 in 0.629s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bfc53c68-42c2-41b3-b87e-8a6cf9a118d4 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:40 devstack sudo[85048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bfc53c68-42c2-41b3-b87e-8a6cf9a118d4 Apr 15 20:06:40 devstack sudo[85048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:41 devstack sudo[85048]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bfc53c68-42c2-41b3-b87e-8a6cf9a118d4" returned: 0 in 0.518s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:41 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:06:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (860dfdca-2341-4a44-bcc1-c72d46c5fb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfc53c68-42c2-41b3-b87e-8a6cf9a118d4', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae3d3d7-3177-41d9-9c1e-8b01180627a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:41 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Volume volume-bfc53c68-42c2-41b3-b87e-8a6cf9a118d4 (bfc53c68-42c2-41b3-b87e-8a6cf9a118d4): created successfully Apr 15 20:06:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae3d3d7-3177-41d9-9c1e-8b01180627a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Flow 'volume_create_manager' (66a434e2-6c26-48ca-8ddc-a5288ffbff2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:06:41 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-da72c8dc-1b2b-46ae-ab3f-74cde8a26a4f tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Created volume successfully. Apr 15 20:06:41 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e941d5e3-bbbf-43ef-82e8-ab404f468ba3 tempest-DeleteServersTestJSON-1751854506 None] Acquiring lock "cinder-5f43cc18-e64c-414e-a941-244923d9ad23-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:06:41 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e941d5e3-bbbf-43ef-82e8-ab404f468ba3 tempest-DeleteServersTestJSON-1751854506 None] Lock "cinder-5f43cc18-e64c-414e-a941-244923d9ad23-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:06:41 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e941d5e3-bbbf-43ef-82e8-ab404f468ba3 tempest-DeleteServersTestJSON-1751854506 None] Acquiring lock "cinder-quobyte-5f43cc18-e64c-414e-a941-244923d9ad23" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:06:41 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e941d5e3-bbbf-43ef-82e8-ab404f468ba3 tempest-DeleteServersTestJSON-1751854506 None] Lock "cinder-quobyte-5f43cc18-e64c-414e-a941-244923d9ad23" acquired by "delete_volume" :: waited 0.013s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:06:41 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b38b2c0-e396-4f29-8139-98d688e458d2]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:06:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e941d5e3-bbbf-43ef-82e8-ab404f468ba3 tempest-DeleteServersTestJSON-1751854506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5f43cc18-e64c-414e-a941-244923d9ad23 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:41 devstack sudo[85079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5f43cc18-e64c-414e-a941-244923d9ad23 Apr 15 20:06:41 devstack sudo[85079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dc201e2e-234a-4926-98b7-43381d246264 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dc201e2e-234a-4926-98b7-43381d246264 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:42 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-dc201e2e-234a-4926-98b7-43381d246264 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:06:42 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-dc201e2e-234a-4926-98b7-43381d246264 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:06:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dc201e2e-234a-4926-98b7-43381d246264 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dc201e2e-234a-4926-98b7-43381d246264 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:42 devstack sudo[85084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:06:42 devstack sudo[85084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:42 devstack sudo[85079]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e941d5e3-bbbf-43ef-82e8-ab404f468ba3 tempest-DeleteServersTestJSON-1751854506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5f43cc18-e64c-414e-a941-244923d9ad23" returned: 0 in 0.781s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e941d5e3-bbbf-43ef-82e8-ab404f468ba3 tempest-DeleteServersTestJSON-1751854506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5f43cc18-e64c-414e-a941-244923d9ad23 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:42 devstack sudo[85088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5f43cc18-e64c-414e-a941-244923d9ad23 Apr 15 20:06:42 devstack sudo[85088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:42 devstack sudo[85084]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dc201e2e-234a-4926-98b7-43381d246264 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.545s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:42 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-dc201e2e-234a-4926-98b7-43381d246264 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:06:42 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-dc201e2e-234a-4926-98b7-43381d246264 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Retype volume completed successfully. Apr 15 20:06:43 devstack sudo[85088]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e941d5e3-bbbf-43ef-82e8-ab404f468ba3 tempest-DeleteServersTestJSON-1751854506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5f43cc18-e64c-414e-a941-244923d9ad23" returned: 0 in 0.646s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:43 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e941d5e3-bbbf-43ef-82e8-ab404f468ba3 tempest-DeleteServersTestJSON-1751854506 None] Lock "cinder-quobyte-5f43cc18-e64c-414e-a941-244923d9ad23" released by "delete_volume" :: held 1.483s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:06:43 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-e941d5e3-bbbf-43ef-82e8-ab404f468ba3 tempest-DeleteServersTestJSON-1751854506 None] Created reservations ['33304065-33d5-4976-875c-44e7eee03c58', '73872d37-9593-4698-a41e-166110e2e761', '7f632e8c-99f3-46d3-9982-b58ccf219778', 'c5d38468-397c-4326-8fbe-5a2e44a60b79'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:06:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e941d5e3-bbbf-43ef-82e8-ab404f468ba3 tempest-DeleteServersTestJSON-1751854506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e941d5e3-bbbf-43ef-82e8-ab404f468ba3 tempest-DeleteServersTestJSON-1751854506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e941d5e3-bbbf-43ef-82e8-ab404f468ba3 tempest-DeleteServersTestJSON-1751854506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:06:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e941d5e3-bbbf-43ef-82e8-ab404f468ba3 tempest-DeleteServersTestJSON-1751854506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:06:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e941d5e3-bbbf-43ef-82e8-ab404f468ba3 tempest-DeleteServersTestJSON-1751854506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e941d5e3-bbbf-43ef-82e8-ab404f468ba3 tempest-DeleteServersTestJSON-1751854506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:43 devstack sudo[85093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:06:43 devstack sudo[85093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:43 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b35895e0-3ca6-4b9d-a91c-628cb62bcce2 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Acquiring lock "cinder-bfc53c68-42c2-41b3-b87e-8a6cf9a118d4-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:06:43 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b35895e0-3ca6-4b9d-a91c-628cb62bcce2 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Lock "cinder-bfc53c68-42c2-41b3-b87e-8a6cf9a118d4-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:06:43 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b35895e0-3ca6-4b9d-a91c-628cb62bcce2 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Acquiring lock "cinder-quobyte-bfc53c68-42c2-41b3-b87e-8a6cf9a118d4" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:06:43 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b35895e0-3ca6-4b9d-a91c-628cb62bcce2 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Lock "cinder-quobyte-bfc53c68-42c2-41b3-b87e-8a6cf9a118d4" acquired by "delete_volume" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:06:43 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e249337-5988-4f72-8e22-df46f91b8c2d]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:06:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b35895e0-3ca6-4b9d-a91c-628cb62bcce2 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bfc53c68-42c2-41b3-b87e-8a6cf9a118d4 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:43 devstack sudo[85095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bfc53c68-42c2-41b3-b87e-8a6cf9a118d4 Apr 15 20:06:43 devstack sudo[85095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:44 devstack sudo[85093]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e941d5e3-bbbf-43ef-82e8-ab404f468ba3 tempest-DeleteServersTestJSON-1751854506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.693s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:44 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-e941d5e3-bbbf-43ef-82e8-ab404f468ba3 tempest-DeleteServersTestJSON-1751854506 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:06:44 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-e941d5e3-bbbf-43ef-82e8-ab404f468ba3 tempest-DeleteServersTestJSON-1751854506 None] Deleted volume successfully. Apr 15 20:06:44 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e941d5e3-bbbf-43ef-82e8-ab404f468ba3 tempest-DeleteServersTestJSON-1751854506 None] Lock "cinder-5f43cc18-e64c-414e-a941-244923d9ad23-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:06:44 devstack sudo[85095]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b35895e0-3ca6-4b9d-a91c-628cb62bcce2 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bfc53c68-42c2-41b3-b87e-8a6cf9a118d4" returned: 0 in 0.662s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b35895e0-3ca6-4b9d-a91c-628cb62bcce2 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bfc53c68-42c2-41b3-b87e-8a6cf9a118d4 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:44 devstack sudo[85102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bfc53c68-42c2-41b3-b87e-8a6cf9a118d4 Apr 15 20:06:44 devstack sudo[85102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:44 devstack sudo[85102]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b35895e0-3ca6-4b9d-a91c-628cb62bcce2 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bfc53c68-42c2-41b3-b87e-8a6cf9a118d4" returned: 0 in 0.544s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:44 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b35895e0-3ca6-4b9d-a91c-628cb62bcce2 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Lock "cinder-quobyte-bfc53c68-42c2-41b3-b87e-8a6cf9a118d4" released by "delete_volume" :: held 1.259s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:06:44 devstack cinder-volume[82989]: WARNING cinder.quota [None req-b35895e0-3ca6-4b9d-a91c-628cb62bcce2 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:06:44 devstack cinder-volume[82989]: WARNING cinder.quota [None req-b35895e0-3ca6-4b9d-a91c-628cb62bcce2 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:06:44 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-b35895e0-3ca6-4b9d-a91c-628cb62bcce2 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Created reservations ['1c1ec268-4dcc-45f9-80f6-02a79553d04f', '4796c400-38d1-4536-851e-82407328da34', 'c08a7181-2736-4678-ab02-d66e1b9342c4', 'b7803b86-573c-4357-9aa7-44ac2fc55844'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:06:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b35895e0-3ca6-4b9d-a91c-628cb62bcce2 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b35895e0-3ca6-4b9d-a91c-628cb62bcce2 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:45 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b35895e0-3ca6-4b9d-a91c-628cb62bcce2 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:06:45 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b35895e0-3ca6-4b9d-a91c-628cb62bcce2 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:06:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b35895e0-3ca6-4b9d-a91c-628cb62bcce2 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b35895e0-3ca6-4b9d-a91c-628cb62bcce2 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:45 devstack sudo[85105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:06:45 devstack sudo[85105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:45 devstack sudo[85105]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b35895e0-3ca6-4b9d-a91c-628cb62bcce2 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.500s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:45 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-b35895e0-3ca6-4b9d-a91c-628cb62bcce2 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:06:45 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-b35895e0-3ca6-4b9d-a91c-628cb62bcce2 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Deleted volume successfully. Apr 15 20:06:45 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b35895e0-3ca6-4b9d-a91c-628cb62bcce2 tempest-VolumeRetypeWithoutMigrationTest-1817317520 None] Lock "cinder-bfc53c68-42c2-41b3-b87e-8a6cf9a118d4-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:06:48 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:06:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Flow 'volume_create_manager' (236f3121-1810-4543-ab4f-7c79a7f4c037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:06:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b180d2e2-ef9f-438d-a913-b7a3d97858d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b180d2e2-ef9f-438d-a913-b7a3d97858d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1482750524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aaefb4c-127b-45eb-92da-558e3b7c612b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5d3f002bd064be5ae8adab21eec18fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:06:49Z,use_quota=True,user_id='d4b90b702cb54cde93829d15f8a663ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a278d4b-4e74-4d5f-9219-aef10e1a6f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a278d4b-4e74-4d5f-9219-aef10e1a6f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229e8172-f898-4de9-b3be-d72b37af5337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:48 devstack cinder-volume[82989]: DEBUG cinder.image.glance [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Creating Keystone auth plugin from conf {{(pid=82989) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 20:06:49 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229e8172-f898-4de9-b3be-d72b37af5337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3aaefb4c-127b-45eb-92da-558e3b7c612b', 'volume_name': 'volume-3aaefb4c-127b-45eb-92da-558e3b7c612b', 'volume_size': 1, 'image_id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f111d55abd084743b16b1c60d303fb2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c89b049d-8e9b-40a2-9350-466dd874c3a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:49 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1949f98f-6bd1-4bf6-bea6-43bd3d5ce09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:49 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1949f98f-6bd1-4bf6-bea6-43bd3d5ce09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:49 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b85520a0-7b14-4fd5-b433-e974f11e0512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:49 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Volume 3aaefb4c-127b-45eb-92da-558e3b7c612b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3aaefb4c-127b-45eb-92da-558e3b7c612b', 'volume_size': 1, 'image_id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f111d55abd084743b16b1c60d303fb2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c89b049d-8e9b-40a2-9350-466dd874c3a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 20:06:49 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Trying to clone 3aaefb4c-127b-45eb-92da-558e3b7c612b from image c89b049d-8e9b-40a2-9350-466dd874c3a8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}]). {{(pid=82989) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 20:06:49 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_n2_bh8nsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82989) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 20:06:49 devstack cinder-volume[82989]: INFO cinder.image.image_utils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Image download 20.69 MB at 20.69 MB/s Apr 15 20:06:50 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[230f0036-0816-43a8-9066-2062a20f2d78]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:06:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_n2_bh8nsdevstack@QuobyteHD {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:50 devstack sudo[85158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_n2_bh8nsdevstack@QuobyteHD Apr 15 20:06:50 devstack sudo[85158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:50 devstack sudo[85158]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_n2_bh8nsdevstack@QuobyteHD" returned: 0 in 0.872s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:50 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Temporary image c89b049d-8e9b-40a2-9350-466dd874c3a8 is fetched for user d4b90b702cb54cde93829d15f8a663ea. {{(pid=82989) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[735680b0-7589-4ca4-bf3e-9713d0b4782b]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_n2_bh8nsdevstack@QuobyteHD {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Flow 'volume_create_manager' (1e6070ae-2858-401a-8828-e596de3b689a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b63b9ca-2d71-44d8-8ace-fc2bfefa3cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b63b9ca-2d71-44d8-8ace-fc2bfefa3cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1330430194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ff5e14-641d-4460-a4c8-cc72885ef46d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84eea7f6f3814834a0d80bf8286e32fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:06:51Z,use_quota=True,user_id='04ced2e701ae4f2298b29d7b6557dd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d657d2-6c8c-47d5-af1d-f29a5f12e98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d657d2-6c8c-47d5-af1d-f29a5f12e98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05620f5f-909b-4b63-bbef-cbed7934e7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05620f5f-909b-4b63-bbef-cbed7934e7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90ff5e14-641d-4460-a4c8-cc72885ef46d', 'volume_name': 'volume-90ff5e14-641d-4460-a4c8-cc72885ef46d', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bafdc072-22b1-4c4b-8a1e-c06117c3d400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bafdc072-22b1-4c4b-8a1e-c06117c3d400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef74a71-2581-4985-b25c-4143abbf83aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:51 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Volume 90ff5e14-641d-4460-a4c8-cc72885ef46d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90ff5e14-641d-4460-a4c8-cc72885ef46d', 'volume_size': 1} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1330430194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ff5e14-641d-4460-a4c8-cc72885ef46d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84eea7f6f3814834a0d80bf8286e32fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:06:51Z,use_quota=True,user_id='04ced2e701ae4f2298b29d7b6557dd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Creating volume 90ff5e14-641d-4460-a4c8-cc72885ef46d {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:51 devstack sudo[85164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_n2_bh8nsdevstack@QuobyteHD Apr 15 20:06:51 devstack sudo[85164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:06:51 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-90ff5e14-641d-4460-a4c8-cc72885ef46d 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:51 devstack sudo[85166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-90ff5e14-641d-4460-a4c8-cc72885ef46d 1073741824 Apr 15 20:06:51 devstack sudo[85166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:51 devstack sudo[85164]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_n2_bh8nsdevstack@QuobyteHD" returned: 0 in 0.652s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:51 devstack sudo[85166]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-90ff5e14-641d-4460-a4c8-cc72885ef46d 1073741824" returned: 0 in 0.785s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-90ff5e14-641d-4460-a4c8-cc72885ef46d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:51 devstack sudo[85174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-90ff5e14-641d-4460-a4c8-cc72885ef46d Apr 15 20:06:51 devstack sudo[85174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:52 devstack sudo[85174]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-90ff5e14-641d-4460-a4c8-cc72885ef46d" returned: 0 in 0.521s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:52 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:06:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.827s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:52 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1482750524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aaefb4c-127b-45eb-92da-558e3b7c612b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5d3f002bd064be5ae8adab21eec18fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:06:49Z,use_quota=True,user_id='d4b90b702cb54cde93829d15f8a663ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:06:52 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Creating volume 3aaefb4c-127b-45eb-92da-558e3b7c612b {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:06:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:52 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:06:52 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:06:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:52 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:06:52 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:06:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef74a71-2581-4985-b25c-4143abbf83aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90ff5e14-641d-4460-a4c8-cc72885ef46d', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c56fb2d-9a39-4457-b6b7-32111ceb046b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:06:52 devstack sudo[85178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b 1073741824 Apr 15 20:06:52 devstack sudo[85178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:52 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Volume volume-90ff5e14-641d-4460-a4c8-cc72885ef46d (90ff5e14-641d-4460-a4c8-cc72885ef46d): created successfully Apr 15 20:06:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c56fb2d-9a39-4457-b6b7-32111ceb046b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:06:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Flow 'volume_create_manager' (1e6070ae-2858-401a-8828-e596de3b689a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:06:52 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-f766eeea-258e-4a54-bbc0-9712ebc7afef tempest-VolumesServicesTestJSON-700217006 None] Created volume successfully. Apr 15 20:06:53 devstack sudo[85178]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b 1073741824" returned: 0 in 0.594s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:53 devstack sudo[85186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b Apr 15 20:06:53 devstack sudo[85186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:53 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-76dff53d-c586-4dfb-987c-7700e65b3891 tempest-VolumesServicesTestJSON-700217006 None] Acquiring lock "cinder-90ff5e14-641d-4460-a4c8-cc72885ef46d-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:06:53 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-76dff53d-c586-4dfb-987c-7700e65b3891 tempest-VolumesServicesTestJSON-700217006 None] Lock "cinder-90ff5e14-641d-4460-a4c8-cc72885ef46d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:06:53 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-76dff53d-c586-4dfb-987c-7700e65b3891 tempest-VolumesServicesTestJSON-700217006 None] Acquiring lock "cinder-quobyte-90ff5e14-641d-4460-a4c8-cc72885ef46d" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:06:53 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-76dff53d-c586-4dfb-987c-7700e65b3891 tempest-VolumesServicesTestJSON-700217006 None] Lock "cinder-quobyte-90ff5e14-641d-4460-a4c8-cc72885ef46d" acquired by "delete_volume" :: waited 0.014s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:06:53 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d3875b-a37a-49d5-8d54-016a2e3763d8]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:06:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-76dff53d-c586-4dfb-987c-7700e65b3891 tempest-VolumesServicesTestJSON-700217006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-90ff5e14-641d-4460-a4c8-cc72885ef46d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:53 devstack sudo[85189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-90ff5e14-641d-4460-a4c8-cc72885ef46d Apr 15 20:06:53 devstack sudo[85189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:53 devstack sudo[85186]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b" returned: 0 in 0.704s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:53 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:06:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:53 devstack cinder-volume[82989]: DEBUG cinder.volume.volume_utils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Attempting download of c89b049d-8e9b-40a2-9350-466dd874c3a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}])) to volume 3aaefb4c-127b-45eb-92da-558e3b7c612b. {{(pid=82989) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 20:06:53 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2df040-b278-45fe-98ee-5d44d4f27200]: (4, 'raw') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:06:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_mtjm8otg {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:54 devstack sudo[85194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_mtjm8otg Apr 15 20:06:54 devstack sudo[85194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:54 devstack sudo[85189]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-76dff53d-c586-4dfb-987c-7700e65b3891 tempest-VolumesServicesTestJSON-700217006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-90ff5e14-641d-4460-a4c8-cc72885ef46d" returned: 0 in 0.854s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-76dff53d-c586-4dfb-987c-7700e65b3891 tempest-VolumesServicesTestJSON-700217006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-90ff5e14-641d-4460-a4c8-cc72885ef46d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:54 devstack sudo[85199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-90ff5e14-641d-4460-a4c8-cc72885ef46d Apr 15 20:06:54 devstack sudo[85199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:54 devstack sudo[85194]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_mtjm8otg" returned: 0 in 0.738s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_mtjm8otg {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:54 devstack sudo[85203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_mtjm8otg Apr 15 20:06:54 devstack sudo[85203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:54 devstack sudo[85199]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-76dff53d-c586-4dfb-987c-7700e65b3891 tempest-VolumesServicesTestJSON-700217006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-90ff5e14-641d-4460-a4c8-cc72885ef46d" returned: 0 in 0.628s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:54 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-76dff53d-c586-4dfb-987c-7700e65b3891 tempest-VolumesServicesTestJSON-700217006 None] Lock "cinder-quobyte-90ff5e14-641d-4460-a4c8-cc72885ef46d" released by "delete_volume" :: held 1.511s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:06:55 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-76dff53d-c586-4dfb-987c-7700e65b3891 tempest-VolumesServicesTestJSON-700217006 None] Created reservations ['5b03460a-5b13-4150-a477-55b88b89100a', '04c4d97b-08cd-463a-8fc8-c1975882416d', 'a03c2f82-4994-456b-8258-e0a0f7a35a37', 'f711d51d-9381-4c15-870b-31136aabd80f'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:06:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-76dff53d-c586-4dfb-987c-7700e65b3891 tempest-VolumesServicesTestJSON-700217006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:06:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-76dff53d-c586-4dfb-987c-7700e65b3891 tempest-VolumesServicesTestJSON-700217006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:06:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-76dff53d-c586-4dfb-987c-7700e65b3891 tempest-VolumesServicesTestJSON-700217006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:06:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-76dff53d-c586-4dfb-987c-7700e65b3891 tempest-VolumesServicesTestJSON-700217006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:06:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-76dff53d-c586-4dfb-987c-7700e65b3891 tempest-VolumesServicesTestJSON-700217006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:06:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-76dff53d-c586-4dfb-987c-7700e65b3891 tempest-VolumesServicesTestJSON-700217006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:55 devstack sudo[85206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:06:55 devstack sudo[85206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:55 devstack sudo[85203]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_mtjm8otg" returned: 1 in 0.620s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_mtjm8otg' failed. Not Retrying. {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 20:06:55 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3d71a7-5231-4593-bfc6-9d129162c37d]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:06:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_n2_bh8nsdevstack@QuobyteHD {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:55 devstack sudo[85210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_n2_bh8nsdevstack@QuobyteHD Apr 15 20:06:55 devstack sudo[85210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:56 devstack sudo[85206]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-76dff53d-c586-4dfb-987c-7700e65b3891 tempest-VolumesServicesTestJSON-700217006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.885s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:56 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-76dff53d-c586-4dfb-987c-7700e65b3891 tempest-VolumesServicesTestJSON-700217006 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:06:56 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-76dff53d-c586-4dfb-987c-7700e65b3891 tempest-VolumesServicesTestJSON-700217006 None] Deleted volume successfully. Apr 15 20:06:56 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-76dff53d-c586-4dfb-987c-7700e65b3891 tempest-VolumesServicesTestJSON-700217006 None] Lock "cinder-90ff5e14-641d-4460-a4c8-cc72885ef46d-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:06:56 devstack sudo[85210]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_n2_bh8nsdevstack@QuobyteHD" returned: 0 in 0.860s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:56 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] c89b049d-8e9b-40a2-9350-466dd874c3a8 was qcow2, converting to raw {{(pid=82989) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 20:06:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_n2_bh8nsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:56 devstack sudo[85216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_n2_bh8nsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b Apr 15 20:06:56 devstack sudo[85216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:57 devstack sudo[85216]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_n2_bh8nsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b" returned: 0 in 1.186s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:57 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_n2_bh8nsdevstack@QuobyteHD, size 112.00 MB, duration 1.19 sec, destination /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b {{(pid=82989) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 20:06:57 devstack cinder-volume[82989]: INFO cinder.image.image_utils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Converted 112.00 MB image at 94.31 MB/s Apr 15 20:06:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:57 devstack sudo[85234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b 1G Apr 15 20:06:57 devstack sudo[85234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:57 devstack sudo[85234]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b 1G" returned: 0 in 0.640s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:58 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ea09bc-63b4-4816-a70d-e48e67e2c250]: (4, 'raw') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:06:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:58 devstack sudo[85240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b Apr 15 20:06:58 devstack sudo[85240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:06:59 devstack sudo[85240]: pam_unix(sudo:session): session closed for user root Apr 15 20:06:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b" returned: 0 in 1.008s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:06:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:06:59 devstack sudo[85244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b Apr 15 20:06:59 devstack sudo[85244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Flow 'volume_create_manager' (e0b07a30-9b1a-4637-9caf-9690f7b8dda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a14b92-ca48-459f-b21c-42161b00e541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a14b92-ca48-459f-b21c-42161b00e541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:07:00Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3fc91f-ffc4-4645-96e1-481fcbfae4d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce1504bdbfbd49b88236832fd7fa8bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:00Z,use_quota=True,user_id='7d5c23daf26d48eb8d0888573d01df30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95168856-8f04-4a64-89b1-62e75a1d168a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95168856-8f04-4a64-89b1-62e75a1d168a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9a30de-3b09-4b62-8b5e-f2c25688b486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG cinder.image.glance [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Creating Keystone auth plugin from conf {{(pid=82989) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9a30de-3b09-4b62-8b5e-f2c25688b486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ba3fc91f-ffc4-4645-96e1-481fcbfae4d0', 'volume_name': 'volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0', 'volume_size': 1, 'image_id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f111d55abd084743b16b1c60d303fb2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c89b049d-8e9b-40a2-9350-466dd874c3a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (131cbf03-1e9d-435f-9af0-060ed720abaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (131cbf03-1e9d-435f-9af0-060ed720abaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b4b56f7-72ef-4540-8a56-df58b0ec3b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:00 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Volume ba3fc91f-ffc4-4645-96e1-481fcbfae4d0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0', 'volume_size': 1, 'image_id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f111d55abd084743b16b1c60d303fb2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c89b049d-8e9b-40a2-9350-466dd874c3a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Trying to clone ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 from image c89b049d-8e9b-40a2-9350-466dd874c3a8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}]). {{(pid=82989) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 20:07:00 devstack sudo[85244]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b" returned: 1 in 1.442s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b' failed. Not Retrying. {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG cinder.volume.volume_utils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Downloaded image c89b049d-8e9b-40a2-9350-466dd874c3a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}])) to volume 3aaefb4c-127b-45eb-92da-558e3b7c612b successfully. {{(pid=82989) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Temporary image c89b049d-8e9b-40a2-9350-466dd874c3a8 for user d4b90b702cb54cde93829d15f8a663ea is deleted. {{(pid=82989) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG cinder.volume.volume_utils [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Marking volume 3aaefb4c-127b-45eb-92da-558e3b7c612b as bootable. {{(pid=82989) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Copying metadata from image c89b049d-8e9b-40a2-9350-466dd874c3a8 to 3aaefb4c-127b-45eb-92da-558e3b7c612b. {{(pid=82989) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Creating volume glance metadata for volume 3aaefb4c-127b-45eb-92da-558e3b7c612b backed by image c89b049d-8e9b-40a2-9350-466dd874c3a8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82989) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b85520a0-7b14-4fd5-b433-e974f11e0512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aaefb4c-127b-45eb-92da-558e3b7c612b', 'volume_size': 1, 'image_id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f111d55abd084743b16b1c60d303fb2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c89b049d-8e9b-40a2-9350-466dd874c3a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8921973-fb5f-475f-b606-2094c65f88c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:00 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Volume volume-3aaefb4c-127b-45eb-92da-558e3b7c612b (3aaefb4c-127b-45eb-92da-558e3b7c612b): created successfully Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8921973-fb5f-475f-b606-2094c65f88c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Flow 'volume_create_manager' (236f3121-1810-4543-ab4f-7c79a7f4c037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:07:00 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-125e9ddd-b353-4512-b8c7-91ecafff4423 tempest-VolumesImageMetadata-113866583 None] Created volume successfully. Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_8u7_9kchdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82989) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 20:07:00 devstack cinder-volume[82989]: INFO cinder.image.image_utils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Image download 20.69 MB at 20.69 MB/s Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e90324-5633-49e3-86b8-ff7c80135d4e]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:07:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_8u7_9kchdevstack@QuobyteHD {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:00 devstack sudo[85261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_8u7_9kchdevstack@QuobyteHD Apr 15 20:07:00 devstack sudo[85261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:01 devstack sudo[85261]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_8u7_9kchdevstack@QuobyteHD" returned: 0 in 0.619s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:01 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Temporary image c89b049d-8e9b-40a2-9350-466dd874c3a8 is fetched for user 7d5c23daf26d48eb8d0888573d01df30. {{(pid=82989) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 20:07:01 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed9cb8e-1d32-4c6f-bd46-adc573f8bb11]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:07:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_8u7_9kchdevstack@QuobyteHD {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:01 devstack sudo[85270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_8u7_9kchdevstack@QuobyteHD Apr 15 20:07:01 devstack sudo[85270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-abd92c17-4262-48b5-873c-1b2867d8c843 tempest-VolumesImageMetadata-113866583 None] Acquiring lock "cinder-3aaefb4c-127b-45eb-92da-558e3b7c612b-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-abd92c17-4262-48b5-873c-1b2867d8c843 tempest-VolumesImageMetadata-113866583 None] Lock "cinder-3aaefb4c-127b-45eb-92da-558e3b7c612b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-abd92c17-4262-48b5-873c-1b2867d8c843 tempest-VolumesImageMetadata-113866583 None] Acquiring lock "cinder-quobyte-3aaefb4c-127b-45eb-92da-558e3b7c612b" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-abd92c17-4262-48b5-873c-1b2867d8c843 tempest-VolumesImageMetadata-113866583 None] Lock "cinder-quobyte-3aaefb4c-127b-45eb-92da-558e3b7c612b" acquired by "delete_volume" :: waited 0.028s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e34eb0a-2744-4d68-93a3-27995e9680ff]: (4, 'raw') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-abd92c17-4262-48b5-873c-1b2867d8c843 tempest-VolumesImageMetadata-113866583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:02 devstack sudo[85276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b Apr 15 20:07:02 devstack sudo[85276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Flow 'volume_create_manager' (61c34bab-47d8-4ca2-957c-81e7cc6e8f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983e6805-ffbc-408c-8793-ccb2cd55878c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:02 devstack sudo[85270]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983e6805-ffbc-408c-8793-ccb2cd55878c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-110900526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f94b6b66-748b-4fc7-b588-22f20810b84f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='057e75a276ec4c1499178e8d73209601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:02Z,use_quota=True,user_id='f5d3fbc25c4b4eb9a9b1eb9904c15d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22088e57-ba43-4068-af36-3a4a62ea05cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22088e57-ba43-4068-af36-3a4a62ea05cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1f02ab-01d4-443b-ac50-114e26f1618f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1f02ab-01d4-443b-ac50-114e26f1618f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f94b6b66-748b-4fc7-b588-22f20810b84f', 'volume_name': 'volume-f94b6b66-748b-4fc7-b588-22f20810b84f', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f27b986-b7aa-43e6-9646-9fe000ed4c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f27b986-b7aa-43e6-9646-9fe000ed4c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607b15bc-9aff-4fea-87d0-ec9e79a1532e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:02 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Volume f94b6b66-748b-4fc7-b588-22f20810b84f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f94b6b66-748b-4fc7-b588-22f20810b84f', 'volume_size': 1} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-110900526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f94b6b66-748b-4fc7-b588-22f20810b84f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='057e75a276ec4c1499178e8d73209601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:02Z,use_quota=True,user_id='f5d3fbc25c4b4eb9a9b1eb9904c15d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Creating volume f94b6b66-748b-4fc7-b588-22f20810b84f {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:07:02 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_8u7_9kchdevstack@QuobyteHD" returned: 0 in 0.941s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:02 devstack sudo[85278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f 1073741824 Apr 15 20:07:02 devstack sudo[85278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:02 devstack sudo[85276]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-abd92c17-4262-48b5-873c-1b2867d8c843 tempest-VolumesImageMetadata-113866583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b" returned: 0 in 0.613s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-abd92c17-4262-48b5-873c-1b2867d8c843 tempest-VolumesImageMetadata-113866583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:02 devstack sudo[85282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b Apr 15 20:07:02 devstack sudo[85282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:03 devstack sudo[85278]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f 1073741824" returned: 0 in 0.605s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:03 devstack sudo[85291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f Apr 15 20:07:03 devstack sudo[85291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:03 devstack sudo[85282]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-abd92c17-4262-48b5-873c-1b2867d8c843 tempest-VolumesImageMetadata-113866583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b" returned: 1 in 0.660s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-abd92c17-4262-48b5-873c-1b2867d8c843 tempest-VolumesImageMetadata-113866583 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b' failed. Not Retrying. {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 20:07:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-abd92c17-4262-48b5-873c-1b2867d8c843 tempest-VolumesImageMetadata-113866583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:03 devstack sudo[85297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b Apr 15 20:07:03 devstack sudo[85297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:03 devstack sudo[85291]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f" returned: 0 in 0.464s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:03 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:07:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.095s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:03 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:07:00Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3fc91f-ffc4-4645-96e1-481fcbfae4d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce1504bdbfbd49b88236832fd7fa8bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:00Z,use_quota=True,user_id='7d5c23daf26d48eb8d0888573d01df30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:07:03 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Creating volume ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:07:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:03 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:07:03 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:07:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:03 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:07:03 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:07:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:03 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607b15bc-9aff-4fea-87d0-ec9e79a1532e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f94b6b66-748b-4fc7-b588-22f20810b84f', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:03 devstack sudo[85299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 1073741824 Apr 15 20:07:03 devstack sudo[85299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:03 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35555306-973e-4cf2-8776-abed54d09208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:03 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Volume volume-f94b6b66-748b-4fc7-b588-22f20810b84f (f94b6b66-748b-4fc7-b588-22f20810b84f): created successfully Apr 15 20:07:03 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35555306-973e-4cf2-8776-abed54d09208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:03 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Flow 'volume_create_manager' (61c34bab-47d8-4ca2-957c-81e7cc6e8f09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:07:03 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-b57a43e4-36ce-4ece-8a37-821b460e3b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Created volume successfully. Apr 15 20:07:04 devstack sudo[85297]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-abd92c17-4262-48b5-873c-1b2867d8c843 tempest-VolumesImageMetadata-113866583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3aaefb4c-127b-45eb-92da-558e3b7c612b" returned: 0 in 0.559s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:04 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-abd92c17-4262-48b5-873c-1b2867d8c843 tempest-VolumesImageMetadata-113866583 None] Lock "cinder-quobyte-3aaefb4c-127b-45eb-92da-558e3b7c612b" released by "delete_volume" :: held 1.914s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:04 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-abd92c17-4262-48b5-873c-1b2867d8c843 tempest-VolumesImageMetadata-113866583 None] Created reservations ['153e1dad-9582-4261-9dc8-d944a728223a', '0494d1ac-d4f4-42d3-808e-ad2be8d9d509', '1fb8945a-1210-46d9-b1f1-2255ad09018e', 'c1e3d667-780e-4334-a1a6-399c9c71fc46'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:07:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-abd92c17-4262-48b5-873c-1b2867d8c843 tempest-VolumesImageMetadata-113866583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-abd92c17-4262-48b5-873c-1b2867d8c843 tempest-VolumesImageMetadata-113866583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-abd92c17-4262-48b5-873c-1b2867d8c843 tempest-VolumesImageMetadata-113866583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:07:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-abd92c17-4262-48b5-873c-1b2867d8c843 tempest-VolumesImageMetadata-113866583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:07:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-abd92c17-4262-48b5-873c-1b2867d8c843 tempest-VolumesImageMetadata-113866583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-abd92c17-4262-48b5-873c-1b2867d8c843 tempest-VolumesImageMetadata-113866583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:04 devstack sudo[85323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:07:04 devstack sudo[85323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:04 devstack sudo[85299]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 1073741824" returned: 0 in 0.634s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:04 devstack sudo[85325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 Apr 15 20:07:04 devstack sudo[85325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-46fd5a0f-2fad-47ee-bc9d-8aa3845278bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:04 devstack sudo[85323]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-abd92c17-4262-48b5-873c-1b2867d8c843 tempest-VolumesImageMetadata-113866583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.742s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:04 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-abd92c17-4262-48b5-873c-1b2867d8c843 tempest-VolumesImageMetadata-113866583 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:07:04 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-abd92c17-4262-48b5-873c-1b2867d8c843 tempest-VolumesImageMetadata-113866583 None] Deleted volume successfully. Apr 15 20:07:04 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-abd92c17-4262-48b5-873c-1b2867d8c843 tempest-VolumesImageMetadata-113866583 None] Lock "cinder-3aaefb4c-127b-45eb-92da-558e3b7c612b-delete_volume" released by "delete_volume" :: held 2.954s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:05 devstack sudo[85325]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0" returned: 0 in 0.778s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:07:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-46fd5a0f-2fad-47ee-bc9d-8aa3845278bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.425s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-46fd5a0f-2fad-47ee-bc9d-8aa3845278bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Creating offline snapshot d07b8c94-8b14-4ba9-b78f-23f644ab10de of volume f94b6b66-748b-4fc7-b588-22f20810b84f {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:07:05 devstack cinder-volume[82989]: DEBUG cinder.volume.volume_utils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Attempting download of c89b049d-8e9b-40a2-9350-466dd874c3a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}])) to volume ba3fc91f-ffc4-4645-96e1-481fcbfae4d0. {{(pid=82989) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 20:07:05 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[333aab48-d2f5-4c42-99c6-4497b9cb3a9c]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:07:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-46fd5a0f-2fad-47ee-bc9d-8aa3845278bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:05 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ad1413-cb00-4bd0-a9df-451478fd1ac6]: (4, 'raw') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:07:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_dj7eqwv9 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:05 devstack sudo[85329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f Apr 15 20:07:05 devstack sudo[85329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:05 devstack sudo[85330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_dj7eqwv9 Apr 15 20:07:05 devstack sudo[85330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:05 devstack sudo[85329]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-46fd5a0f-2fad-47ee-bc9d-8aa3845278bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f" returned: 0 in 0.662s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-46fd5a0f-2fad-47ee-bc9d-8aa3845278bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.d07b8c94-8b14-4ba9-b78f-23f644ab10de 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:05 devstack sudo[85337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.d07b8c94-8b14-4ba9-b78f-23f644ab10de 1G Apr 15 20:07:05 devstack sudo[85337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:05 devstack sudo[85330]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_dj7eqwv9" returned: 0 in 0.805s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_dj7eqwv9 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:06 devstack sudo[85341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_dj7eqwv9 Apr 15 20:07:06 devstack sudo[85341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:06 devstack sudo[85337]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-46fd5a0f-2fad-47ee-bc9d-8aa3845278bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.d07b8c94-8b14-4ba9-b78f-23f644ab10de 1G" returned: 0 in 0.916s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-46fd5a0f-2fad-47ee-bc9d-8aa3845278bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f94b6b66-748b-4fc7-b588-22f20810b84f -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.d07b8c94-8b14-4ba9-b78f-23f644ab10de {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:06 devstack sudo[85347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f94b6b66-748b-4fc7-b588-22f20810b84f -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.d07b8c94-8b14-4ba9-b78f-23f644ab10de Apr 15 20:07:06 devstack sudo[85347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:06 devstack sudo[85341]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_dj7eqwv9" returned: 1 in 0.969s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_dj7eqwv9' failed. Not Retrying. {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 20:07:06 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d0bebe-88c8-4cb3-bc06-358afefc3f99]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:07:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_8u7_9kchdevstack@QuobyteHD {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:07 devstack sudo[85350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_8u7_9kchdevstack@QuobyteHD Apr 15 20:07:07 devstack sudo[85350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:07 devstack sudo[85347]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-46fd5a0f-2fad-47ee-bc9d-8aa3845278bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f94b6b66-748b-4fc7-b588-22f20810b84f -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.d07b8c94-8b14-4ba9-b78f-23f644ab10de" returned: 0 in 0.783s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:07 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-46fd5a0f-2fad-47ee-bc9d-8aa3845278bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.d07b8c94-8b14-4ba9-b78f-23f644ab10de is being set with open permissions: ugo+rw Apr 15 20:07:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-46fd5a0f-2fad-47ee-bc9d-8aa3845278bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.d07b8c94-8b14-4ba9-b78f-23f644ab10de {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:07 devstack sudo[85390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.d07b8c94-8b14-4ba9-b78f-23f644ab10de Apr 15 20:07:07 devstack sudo[85390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:07 devstack sudo[85350]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_8u7_9kchdevstack@QuobyteHD" returned: 0 in 0.848s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:07 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] c89b049d-8e9b-40a2-9350-466dd874c3a8 was qcow2, converting to raw {{(pid=82989) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 20:07:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_8u7_9kchdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:07 devstack sudo[85398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_8u7_9kchdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 Apr 15 20:07:07 devstack sudo[85398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:08 devstack sudo[85390]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-46fd5a0f-2fad-47ee-bc9d-8aa3845278bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.d07b8c94-8b14-4ba9-b78f-23f644ab10de" returned: 0 in 0.999s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-46fd5a0f-2fad-47ee-bc9d-8aa3845278bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:08 devstack sudo[85430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.info Apr 15 20:07:08 devstack sudo[85430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:09 devstack sudo[85430]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-46fd5a0f-2fad-47ee-bc9d-8aa3845278bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.info" returned: 0 in 0.535s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:09 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-46fd5a0f-2fad-47ee-bc9d-8aa3845278bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.info is being set with open permissions: ugo+rw Apr 15 20:07:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-46fd5a0f-2fad-47ee-bc9d-8aa3845278bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:09 devstack sudo[85434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.info Apr 15 20:07:09 devstack sudo[85434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:09 devstack sudo[85398]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_8u7_9kchdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0" returned: 0 in 1.345s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:09 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_8u7_9kchdevstack@QuobyteHD, size 112.00 MB, duration 1.35 sec, destination /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 {{(pid=82989) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 20:07:09 devstack cinder-volume[82989]: INFO cinder.image.image_utils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Converted 112.00 MB image at 83.18 MB/s Apr 15 20:07:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:09 devstack sudo[85436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 1G Apr 15 20:07:09 devstack sudo[85436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:09 devstack sudo[85434]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-46fd5a0f-2fad-47ee-bc9d-8aa3845278bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.info" returned: 0 in 0.604s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-46fd5a0f-2fad-47ee-bc9d-8aa3845278bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.573s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:09 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-46fd5a0f-2fad-47ee-bc9d-8aa3845278bb tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Create snapshot completed successfully Apr 15 20:07:09 devstack sudo[85436]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 1G" returned: 0 in 0.656s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:09 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[0435d555-9339-4d5c-8faa-0bb220a82f81]: (4, 'raw') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:07:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:09 devstack sudo[85442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 Apr 15 20:07:09 devstack sudo[85442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-984a2378-de0a-454a-9241-833d69b953d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Acquiring lock "cinder-d07b8c94-8b14-4ba9-b78f-23f644ab10de-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-984a2378-de0a-454a-9241-833d69b953d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Lock "cinder-d07b8c94-8b14-4ba9-b78f-23f644ab10de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-984a2378-de0a-454a-9241-833d69b953d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Acquiring lock "cinder-quobyte-f94b6b66-748b-4fc7-b588-22f20810b84f" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-984a2378-de0a-454a-9241-833d69b953d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Lock "cinder-quobyte-f94b6b66-748b-4fc7-b588-22f20810b84f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-984a2378-de0a-454a-9241-833d69b953d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Acquiring lock "cinder-quobyte-d07b8c94-8b14-4ba9-b78f-23f644ab10de" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-984a2378-de0a-454a-9241-833d69b953d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Lock "cinder-quobyte-d07b8c94-8b14-4ba9-b78f-23f644ab10de" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:10 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-984a2378-de0a-454a-9241-833d69b953d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Deleting offline snapshot d07b8c94-8b14-4ba9-b78f-23f644ab10de of volume f94b6b66-748b-4fc7-b588-22f20810b84f {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:07:10 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-984a2378-de0a-454a-9241-833d69b953d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] snapshot_file for this snap is: volume-f94b6b66-748b-4fc7-b588-22f20810b84f.d07b8c94-8b14-4ba9-b78f-23f644ab10de {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:07:10 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[58aabce6-5ee7-410b-a716-bc95bace857b]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:07:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-984a2378-de0a-454a-9241-833d69b953d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.d07b8c94-8b14-4ba9-b78f-23f644ab10de {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:10 devstack sudo[85444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.d07b8c94-8b14-4ba9-b78f-23f644ab10de Apr 15 20:07:10 devstack sudo[85444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:10 devstack sudo[85442]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0" returned: 0 in 0.723s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:10 devstack sudo[85448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 Apr 15 20:07:10 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:11 devstack sudo[85444]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-984a2378-de0a-454a-9241-833d69b953d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.d07b8c94-8b14-4ba9-b78f-23f644ab10de" returned: 0 in 0.719s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-984a2378-de0a-454a-9241-833d69b953d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f94b6b66-748b-4fc7-b588-22f20810b84f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[1836f295-1e4b-4898-ac26-855b96432a0a]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-984a2378-de0a-454a-9241-833d69b953d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:11 devstack sudo[85453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f Apr 15 20:07:11 devstack sudo[85453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Flow 'volume_create_manager' (46080354-f057-4130-85b1-f278acc16a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (041f9139-7c15-40fe-a9b3-2bb81a69cccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (041f9139-7c15-40fe-a9b3-2bb81a69cccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1197500708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed9054d-9ed2-48ec-aae1-34d5bcce5265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a69ee14f0d9431fa3beae6d270a9c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:11Z,use_quota=True,user_id='483614ccc58e49669c26004cbd2bdc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5556ee7b-25a3-4720-b4df-11701de086b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5556ee7b-25a3-4720-b4df-11701de086b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17eba136-62d4-45db-ab3a-4e4ba0937fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17eba136-62d4-45db-ab3a-4e4ba0937fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bed9054d-9ed2-48ec-aae1-34d5bcce5265', 'volume_name': 'volume-bed9054d-9ed2-48ec-aae1-34d5bcce5265', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (973dc5f3-be0a-43bd-9329-a9e613b89d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (973dc5f3-be0a-43bd-9329-a9e613b89d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7628ff1-30d1-412e-be43-3237ed38baa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:11 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Volume bed9054d-9ed2-48ec-aae1-34d5bcce5265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bed9054d-9ed2-48ec-aae1-34d5bcce5265', 'volume_size': 1} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1197500708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed9054d-9ed2-48ec-aae1-34d5bcce5265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a69ee14f0d9431fa3beae6d270a9c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:11Z,use_quota=True,user_id='483614ccc58e49669c26004cbd2bdc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Creating volume bed9054d-9ed2-48ec-aae1-34d5bcce5265 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:07:11 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bed9054d-9ed2-48ec-aae1-34d5bcce5265 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:11 devstack sudo[85458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bed9054d-9ed2-48ec-aae1-34d5bcce5265 1073741824 Apr 15 20:07:11 devstack sudo[85458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:11 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0" returned: 1 in 0.726s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0' failed. Not Retrying. {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.volume_utils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Downloaded image c89b049d-8e9b-40a2-9350-466dd874c3a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}])) to volume ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 successfully. {{(pid=82989) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Temporary image c89b049d-8e9b-40a2-9350-466dd874c3a8 for user 7d5c23daf26d48eb8d0888573d01df30 is deleted. {{(pid=82989) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.volume_utils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Marking volume ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 as bootable. {{(pid=82989) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Copying metadata from image c89b049d-8e9b-40a2-9350-466dd874c3a8 to ba3fc91f-ffc4-4645-96e1-481fcbfae4d0. {{(pid=82989) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Creating volume glance metadata for volume ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 backed by image c89b049d-8e9b-40a2-9350-466dd874c3a8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82989) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b4b56f7-72ef-4540-8a56-df58b0ec3b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0', 'volume_size': 1, 'image_id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f111d55abd084743b16b1c60d303fb2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c89b049d-8e9b-40a2-9350-466dd874c3a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e88c4f78-3bf4-4c38-ad2c-5c8749772824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:11 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Volume volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 (ba3fc91f-ffc4-4645-96e1-481fcbfae4d0): created successfully Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e88c4f78-3bf4-4c38-ad2c-5c8749772824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Flow 'volume_create_manager' (e0b07a30-9b1a-4637-9caf-9690f7b8dda5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:07:11 devstack cinder-volume[82989]: INFO cinder.volume.manager [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-7846fc3e-fab1-4a8f-89b9-b93cec253920 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Created volume successfully. Apr 15 20:07:11 devstack sudo[85453]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-984a2378-de0a-454a-9241-833d69b953d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f" returned: 0 in 0.563s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-984a2378-de0a-454a-9241-833d69b953d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.d07b8c94-8b14-4ba9-b78f-23f644ab10de {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:11 devstack sudo[85466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.d07b8c94-8b14-4ba9-b78f-23f644ab10de Apr 15 20:07:11 devstack sudo[85466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:11 devstack sudo[85458]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bed9054d-9ed2-48ec-aae1-34d5bcce5265 1073741824" returned: 0 in 0.624s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bed9054d-9ed2-48ec-aae1-34d5bcce5265 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:11 devstack sudo[85471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bed9054d-9ed2-48ec-aae1-34d5bcce5265 Apr 15 20:07:11 devstack sudo[85471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:12 devstack sudo[85466]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-984a2378-de0a-454a-9241-833d69b953d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.d07b8c94-8b14-4ba9-b78f-23f644ab10de" returned: 0 in 0.535s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-984a2378-de0a-454a-9241-833d69b953d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.d07b8c94-8b14-4ba9-b78f-23f644ab10de {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:12 devstack sudo[85477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.d07b8c94-8b14-4ba9-b78f-23f644ab10de Apr 15 20:07:12 devstack sudo[85477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:12 devstack sudo[85471]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bed9054d-9ed2-48ec-aae1-34d5bcce5265" returned: 0 in 0.591s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:12 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:07:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:12 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7628ff1-30d1-412e-be43-3237ed38baa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bed9054d-9ed2-48ec-aae1-34d5bcce5265', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:12 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f417539-8d27-4ee0-a5e5-f90c81c7e96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:12 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Volume volume-bed9054d-9ed2-48ec-aae1-34d5bcce5265 (bed9054d-9ed2-48ec-aae1-34d5bcce5265): created successfully Apr 15 20:07:12 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f417539-8d27-4ee0-a5e5-f90c81c7e96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:12 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Flow 'volume_create_manager' (46080354-f057-4130-85b1-f278acc16a34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:07:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-cddf2a72-564b-4cf7-b72b-0a97c0182e28 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-cddf2a72-564b-4cf7-b72b-0a97c0182e28 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:12 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-07cb613c-24e5-4f2c-8931-518396dcac1a tempest-VolumesTransfersTest-496717118 None] Created volume successfully. Apr 15 20:07:12 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59fd27c-bda6-4f70-ae4d-186e71c737db]: (4, 'raw') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:07:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-cddf2a72-564b-4cf7-b72b-0a97c0182e28 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:12 devstack sudo[85488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 Apr 15 20:07:12 devstack sudo[85488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:12 devstack sudo[85477]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-984a2378-de0a-454a-9241-833d69b953d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f.d07b8c94-8b14-4ba9-b78f-23f644ab10de" returned: 0 in 0.495s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:12 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-984a2378-de0a-454a-9241-833d69b953d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Lock "cinder-quobyte-d07b8c94-8b14-4ba9-b78f-23f644ab10de" released by "_delete_snapshot" :: held 2.377s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:12 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-984a2378-de0a-454a-9241-833d69b953d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Lock "cinder-quobyte-f94b6b66-748b-4fc7-b588-22f20810b84f" released by "delete_snapshot" :: held 2.396s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:12 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-984a2378-de0a-454a-9241-833d69b953d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Created reservations ['f0efd580-47ba-4844-bebd-60029fb0542d', '0406fad2-40a8-4dcf-919f-32e9b3cd8ff8', 'f35a7259-8efc-4054-b14c-aa8cac6047ee', '4cd02cd5-acf0-4389-bb93-1ec78f03c60d'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:07:12 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-984a2378-de0a-454a-9241-833d69b953d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Delete snapshot completed successfully. Apr 15 20:07:12 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-984a2378-de0a-454a-9241-833d69b953d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Lock "cinder-d07b8c94-8b14-4ba9-b78f-23f644ab10de-delete_snapshot" released by "delete_snapshot" :: held 2.485s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:12 devstack sudo[85488]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-cddf2a72-564b-4cf7-b72b-0a97c0182e28 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0" returned: 0 in 0.469s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-cddf2a72-564b-4cf7-b72b-0a97c0182e28 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:13 devstack sudo[85493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 Apr 15 20:07:13 devstack sudo[85493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:13 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cafb706c-7c7a-4107-9de7-ed75a1733671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Acquiring lock "cinder-f94b6b66-748b-4fc7-b588-22f20810b84f-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:13 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cafb706c-7c7a-4107-9de7-ed75a1733671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Lock "cinder-f94b6b66-748b-4fc7-b588-22f20810b84f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:13 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cafb706c-7c7a-4107-9de7-ed75a1733671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Acquiring lock "cinder-quobyte-f94b6b66-748b-4fc7-b588-22f20810b84f" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:13 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cafb706c-7c7a-4107-9de7-ed75a1733671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Lock "cinder-quobyte-f94b6b66-748b-4fc7-b588-22f20810b84f" acquired by "delete_volume" :: waited 0.015s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:13 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e033952-fadb-4fe7-ba9f-188c67ca8f34]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:07:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cafb706c-7c7a-4107-9de7-ed75a1733671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:13 devstack sudo[85523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f Apr 15 20:07:13 devstack sudo[85523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:14 devstack sudo[85493]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-cddf2a72-564b-4cf7-b72b-0a97c0182e28 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0" returned: 1 in 1.120s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-cddf2a72-564b-4cf7-b72b-0a97c0182e28 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0' failed. Not Retrying. {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 20:07:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-cddf2a72-564b-4cf7-b72b-0a97c0182e28 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.616s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:14 devstack cinder-volume[82989]: DEBUG dbcounter [-] [82989] Writing DB stats cinder:UPDATE=88,cinder:SELECT=103,cinder:INSERT=33,cinder:DELETE=7 {{(pid=82989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:07:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-cddf2a72-564b-4cf7-b72b-0a97c0182e28 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab', 'name': 'volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91bb8684-b032-40eb-82ac-86e415e7b007', 'enforce_multipath': True} {{(pid=82989) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 20:07:14 devstack cinder-volume[82989]: INFO cinder.volume.manager [req-cf5e4d86-8e93-4275-9e24-947bec0dd18a req-cddf2a72-564b-4cf7-b72b-0a97c0182e28 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] attachment_update completed successfully. Apr 15 20:07:14 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-a8c83aae-9a6d-48db-9639-f3078c4ebf47 tempest-VolumesTransfersTest-2089475726 None] Transfer volume completed successfully. Apr 15 20:07:14 devstack sudo[85523]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cafb706c-7c7a-4107-9de7-ed75a1733671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f" returned: 0 in 0.871s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cafb706c-7c7a-4107-9de7-ed75a1733671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:14 devstack sudo[85533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f Apr 15 20:07:14 devstack sudo[85533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:15 devstack sudo[85533]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cafb706c-7c7a-4107-9de7-ed75a1733671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f94b6b66-748b-4fc7-b588-22f20810b84f" returned: 0 in 0.436s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:15 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cafb706c-7c7a-4107-9de7-ed75a1733671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Lock "cinder-quobyte-f94b6b66-748b-4fc7-b588-22f20810b84f" released by "delete_volume" :: held 1.387s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:15 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-cafb706c-7c7a-4107-9de7-ed75a1733671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Created reservations ['9f9bd32d-15bb-4c1e-87c2-1314df07a130', '7d900ff6-d68a-423c-9b28-f81712c58578', 'bdfeb905-605b-48c8-9b74-59dd14a68dbc', 'fa397264-73ec-49cb-bb77-e0e1bcb082f6'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:07:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cafb706c-7c7a-4107-9de7-ed75a1733671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cafb706c-7c7a-4107-9de7-ed75a1733671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-cafb706c-7c7a-4107-9de7-ed75a1733671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:07:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-cafb706c-7c7a-4107-9de7-ed75a1733671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:07:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cafb706c-7c7a-4107-9de7-ed75a1733671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cafb706c-7c7a-4107-9de7-ed75a1733671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:15 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f60f694d-ff5f-4ed9-bbd2-904253ea484f tempest-VolumesTransfersTest-288112930 None] Acquiring lock "cinder-bed9054d-9ed2-48ec-aae1-34d5bcce5265-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:15 devstack sudo[85538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:07:15 devstack sudo[85538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:15 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f60f694d-ff5f-4ed9-bbd2-904253ea484f tempest-VolumesTransfersTest-288112930 None] Lock "cinder-bed9054d-9ed2-48ec-aae1-34d5bcce5265-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:15 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f60f694d-ff5f-4ed9-bbd2-904253ea484f tempest-VolumesTransfersTest-288112930 None] Acquiring lock "cinder-quobyte-bed9054d-9ed2-48ec-aae1-34d5bcce5265" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:15 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f60f694d-ff5f-4ed9-bbd2-904253ea484f tempest-VolumesTransfersTest-288112930 None] Lock "cinder-quobyte-bed9054d-9ed2-48ec-aae1-34d5bcce5265" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:15 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ecd1ac-36eb-4b92-a76c-7bb2115ed75e]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:07:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f60f694d-ff5f-4ed9-bbd2-904253ea484f tempest-VolumesTransfersTest-288112930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bed9054d-9ed2-48ec-aae1-34d5bcce5265 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:15 devstack sudo[85540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bed9054d-9ed2-48ec-aae1-34d5bcce5265 Apr 15 20:07:15 devstack sudo[85540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:15 devstack sudo[85538]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cafb706c-7c7a-4107-9de7-ed75a1733671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.466s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:15 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-cafb706c-7c7a-4107-9de7-ed75a1733671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:07:15 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-cafb706c-7c7a-4107-9de7-ed75a1733671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Deleted volume successfully. Apr 15 20:07:15 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cafb706c-7c7a-4107-9de7-ed75a1733671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1645906275 None] Lock "cinder-f94b6b66-748b-4fc7-b588-22f20810b84f-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:16 devstack sudo[85540]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f60f694d-ff5f-4ed9-bbd2-904253ea484f tempest-VolumesTransfersTest-288112930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bed9054d-9ed2-48ec-aae1-34d5bcce5265" returned: 0 in 0.775s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f60f694d-ff5f-4ed9-bbd2-904253ea484f tempest-VolumesTransfersTest-288112930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bed9054d-9ed2-48ec-aae1-34d5bcce5265 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:16 devstack sudo[85547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bed9054d-9ed2-48ec-aae1-34d5bcce5265 Apr 15 20:07:16 devstack sudo[85547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:16 devstack sudo[85547]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f60f694d-ff5f-4ed9-bbd2-904253ea484f tempest-VolumesTransfersTest-288112930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-bed9054d-9ed2-48ec-aae1-34d5bcce5265" returned: 0 in 0.629s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:16 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f60f694d-ff5f-4ed9-bbd2-904253ea484f tempest-VolumesTransfersTest-288112930 None] Lock "cinder-quobyte-bed9054d-9ed2-48ec-aae1-34d5bcce5265" released by "delete_volume" :: held 1.430s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:16 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-f60f694d-ff5f-4ed9-bbd2-904253ea484f tempest-VolumesTransfersTest-288112930 None] Created reservations ['64da5b8a-85aa-4216-886c-843757c008cf', '3663f15f-9aad-4001-9943-e88b9740645c', '792f79a4-b8c6-4603-8e75-0d76c9d9eff2', '1d923bc7-8bb4-4d85-a90a-28a749360454'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:07:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f60f694d-ff5f-4ed9-bbd2-904253ea484f tempest-VolumesTransfersTest-288112930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f60f694d-ff5f-4ed9-bbd2-904253ea484f tempest-VolumesTransfersTest-288112930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:16 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f60f694d-ff5f-4ed9-bbd2-904253ea484f tempest-VolumesTransfersTest-288112930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:07:16 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f60f694d-ff5f-4ed9-bbd2-904253ea484f tempest-VolumesTransfersTest-288112930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:07:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f60f694d-ff5f-4ed9-bbd2-904253ea484f tempest-VolumesTransfersTest-288112930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f60f694d-ff5f-4ed9-bbd2-904253ea484f tempest-VolumesTransfersTest-288112930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:16 devstack sudo[85554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:07:16 devstack sudo[85554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:17 devstack sudo[85554]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f60f694d-ff5f-4ed9-bbd2-904253ea484f tempest-VolumesTransfersTest-288112930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.606s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-f60f694d-ff5f-4ed9-bbd2-904253ea484f tempest-VolumesTransfersTest-288112930 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:07:17 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-f60f694d-ff5f-4ed9-bbd2-904253ea484f tempest-VolumesTransfersTest-288112930 None] Deleted volume successfully. Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f60f694d-ff5f-4ed9-bbd2-904253ea484f tempest-VolumesTransfersTest-288112930 None] Lock "cinder-bed9054d-9ed2-48ec-aae1-34d5bcce5265-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Flow 'volume_create_manager' (c8719462-5c85-4a1b-9f87-d975d2733f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e998ba-9184-414a-b9aa-b64a0edc1b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e998ba-9184-414a-b9aa-b64a0edc1b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1604512181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d4ed077-7146-41f9-b452-bc7b928273ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a69ee14f0d9431fa3beae6d270a9c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:18Z,use_quota=True,user_id='483614ccc58e49669c26004cbd2bdc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed9299c-6455-461a-8251-af1d5af4e3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed9299c-6455-461a-8251-af1d5af4e3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac83980e-12ef-4e49-a5bd-1287cc658ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac83980e-12ef-4e49-a5bd-1287cc658ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d4ed077-7146-41f9-b452-bc7b928273ec', 'volume_name': 'volume-5d4ed077-7146-41f9-b452-bc7b928273ec', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fd0506-ce45-4b95-9513-f1f557e2e63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fd0506-ce45-4b95-9513-f1f557e2e63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c721e0-058d-47d2-8f0d-355200758cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:17 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Volume 5d4ed077-7146-41f9-b452-bc7b928273ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d4ed077-7146-41f9-b452-bc7b928273ec', 'volume_size': 1} Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1604512181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d4ed077-7146-41f9-b452-bc7b928273ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a69ee14f0d9431fa3beae6d270a9c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:18Z,use_quota=True,user_id='483614ccc58e49669c26004cbd2bdc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Creating volume 5d4ed077-7146-41f9-b452-bc7b928273ec {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:07:17 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:07:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d4ed077-7146-41f9-b452-bc7b928273ec 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:17 devstack sudo[85562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d4ed077-7146-41f9-b452-bc7b928273ec 1073741824 Apr 15 20:07:17 devstack sudo[85562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:18 devstack sudo[85562]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d4ed077-7146-41f9-b452-bc7b928273ec 1073741824" returned: 0 in 0.619s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d4ed077-7146-41f9-b452-bc7b928273ec {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:18 devstack sudo[85567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d4ed077-7146-41f9-b452-bc7b928273ec Apr 15 20:07:18 devstack sudo[85567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:19 devstack sudo[85567]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d4ed077-7146-41f9-b452-bc7b928273ec" returned: 0 in 0.931s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:07:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c721e0-058d-47d2-8f0d-355200758cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d4ed077-7146-41f9-b452-bc7b928273ec', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8afc9ca4-dc29-4105-a61e-5673d08fed4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:19 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Volume volume-5d4ed077-7146-41f9-b452-bc7b928273ec (5d4ed077-7146-41f9-b452-bc7b928273ec): created successfully Apr 15 20:07:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8afc9ca4-dc29-4105-a61e-5673d08fed4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Flow 'volume_create_manager' (c8719462-5c85-4a1b-9f87-d975d2733f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:07:19 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-ca9cbd29-bbae-4248-a534-bc0cb135701f tempest-VolumesTransfersTest-496717118 None] Created volume successfully. Apr 15 20:07:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-382a2c45-c818-4b06-9c4d-03c315e765d1 tempest-VolumesTransfersTest-288112930 None] Acquiring lock "cinder-5d4ed077-7146-41f9-b452-bc7b928273ec-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-382a2c45-c818-4b06-9c4d-03c315e765d1 tempest-VolumesTransfersTest-288112930 None] Lock "cinder-5d4ed077-7146-41f9-b452-bc7b928273ec-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-382a2c45-c818-4b06-9c4d-03c315e765d1 tempest-VolumesTransfersTest-288112930 None] Acquiring lock "cinder-quobyte-5d4ed077-7146-41f9-b452-bc7b928273ec" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-382a2c45-c818-4b06-9c4d-03c315e765d1 tempest-VolumesTransfersTest-288112930 None] Lock "cinder-quobyte-5d4ed077-7146-41f9-b452-bc7b928273ec" acquired by "delete_volume" :: waited 0.030s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:20 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ccded4-2f9e-48f8-9df0-b808b8bf25e0]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:07:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-382a2c45-c818-4b06-9c4d-03c315e765d1 tempest-VolumesTransfersTest-288112930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d4ed077-7146-41f9-b452-bc7b928273ec {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:20 devstack sudo[85597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d4ed077-7146-41f9-b452-bc7b928273ec Apr 15 20:07:20 devstack sudo[85597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:21 devstack sudo[85597]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-382a2c45-c818-4b06-9c4d-03c315e765d1 tempest-VolumesTransfersTest-288112930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d4ed077-7146-41f9-b452-bc7b928273ec" returned: 0 in 1.096s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-382a2c45-c818-4b06-9c4d-03c315e765d1 tempest-VolumesTransfersTest-288112930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d4ed077-7146-41f9-b452-bc7b928273ec {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:21 devstack sudo[85603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d4ed077-7146-41f9-b452-bc7b928273ec Apr 15 20:07:21 devstack sudo[85603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:22 devstack sudo[85603]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-382a2c45-c818-4b06-9c4d-03c315e765d1 tempest-VolumesTransfersTest-288112930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d4ed077-7146-41f9-b452-bc7b928273ec" returned: 0 in 1.144s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-382a2c45-c818-4b06-9c4d-03c315e765d1 tempest-VolumesTransfersTest-288112930 None] Lock "cinder-quobyte-5d4ed077-7146-41f9-b452-bc7b928273ec" released by "delete_volume" :: held 2.331s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:22 devstack cinder-volume[82989]: DEBUG dbcounter [-] [82989] Writing DB stats cinder:UPDATE=134,cinder:SELECT=113,cinder:INSERT=39,cinder:DELETE=10 {{(pid=82989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:07:22 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-382a2c45-c818-4b06-9c4d-03c315e765d1 tempest-VolumesTransfersTest-288112930 None] Created reservations ['e75a9487-cceb-435d-b8f3-c6d8a55a66c9', 'f54378bd-edab-4669-bb0d-5e39ab18344f', '09724f48-bc5c-4453-93fd-80c4361cc76d', '7ad7945c-8f48-4db0-b1db-c3c2e8d59c2d'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:07:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-382a2c45-c818-4b06-9c4d-03c315e765d1 tempest-VolumesTransfersTest-288112930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-382a2c45-c818-4b06-9c4d-03c315e765d1 tempest-VolumesTransfersTest-288112930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-382a2c45-c818-4b06-9c4d-03c315e765d1 tempest-VolumesTransfersTest-288112930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:07:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-382a2c45-c818-4b06-9c4d-03c315e765d1 tempest-VolumesTransfersTest-288112930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:07:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-382a2c45-c818-4b06-9c4d-03c315e765d1 tempest-VolumesTransfersTest-288112930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-382a2c45-c818-4b06-9c4d-03c315e765d1 tempest-VolumesTransfersTest-288112930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:23 devstack sudo[85609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:07:23 devstack sudo[85609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:24 devstack sudo[85609]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-382a2c45-c818-4b06-9c4d-03c315e765d1 tempest-VolumesTransfersTest-288112930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 1.443s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:24 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-382a2c45-c818-4b06-9c4d-03c315e765d1 tempest-VolumesTransfersTest-288112930 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:07:24 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-382a2c45-c818-4b06-9c4d-03c315e765d1 tempest-VolumesTransfersTest-288112930 None] Deleted volume successfully. Apr 15 20:07:24 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-382a2c45-c818-4b06-9c4d-03c315e765d1 tempest-VolumesTransfersTest-288112930 None] Lock "cinder-5d4ed077-7146-41f9-b452-bc7b928273ec-delete_volume" released by "delete_volume" :: held 4.147s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:27 devstack cinder-volume[82989]: DEBUG oslo_service.periodic_task [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82989) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 20:07:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:07:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:07:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:27 devstack sudo[85634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:07:27 devstack sudo[85634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:28 devstack sudo[85634]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.796s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:28 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Flow 'volume_create_manager' (e66e27b6-b998-4ecd-aadf-0cd53d4d6473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a35c73-e493-4fd5-8d82-8cd0ad356fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a35c73-e493-4fd5-8d82-8cd0ad356fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-759797459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=362eb034-d723-4dc3-8c0c-3def4341c228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57f5b7d4201494ba9a0aa79a18a5654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:29Z,use_quota=True,user_id='83b7b4c7bc8a4e159cb039e4c8c2e151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984b16d8-33e4-4b56-a00e-20b7642ae783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984b16d8-33e4-4b56-a00e-20b7642ae783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51032a4-7d96-4547-ac23-bea8ec65b547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51032a4-7d96-4547-ac23-bea8ec65b547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '362eb034-d723-4dc3-8c0c-3def4341c228', 'volume_name': 'volume-362eb034-d723-4dc3-8c0c-3def4341c228', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d63b983-87e8-4673-9bfa-f61e5ba395bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d63b983-87e8-4673-9bfa-f61e5ba395bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bb73e7-4c67-4224-960d-dd7c2530c75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:29 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Volume 362eb034-d723-4dc3-8c0c-3def4341c228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-362eb034-d723-4dc3-8c0c-3def4341c228', 'volume_size': 1} Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-759797459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=362eb034-d723-4dc3-8c0c-3def4341c228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57f5b7d4201494ba9a0aa79a18a5654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:29Z,use_quota=True,user_id='83b7b4c7bc8a4e159cb039e4c8c2e151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Creating volume 362eb034-d723-4dc3-8c0c-3def4341c228 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:07:29 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:29 devstack sudo[85660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228 1073741824 Apr 15 20:07:29 devstack sudo[85660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:29 devstack sudo[85660]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228 1073741824" returned: 0 in 0.557s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:29 devstack sudo[85682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228 Apr 15 20:07:29 devstack sudo[85682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:30 devstack sudo[85682]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228" returned: 0 in 0.441s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:07:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bb73e7-4c67-4224-960d-dd7c2530c75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-362eb034-d723-4dc3-8c0c-3def4341c228', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe84744-9097-4e8d-9bb0-76c0c70ac4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:30 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Volume volume-362eb034-d723-4dc3-8c0c-3def4341c228 (362eb034-d723-4dc3-8c0c-3def4341c228): created successfully Apr 15 20:07:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe84744-9097-4e8d-9bb0-76c0c70ac4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Flow 'volume_create_manager' (e66e27b6-b998-4ecd-aadf-0cd53d4d6473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:07:30 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-45762b85-7b4c-4480-a688-01a60f4b6847 tempest-SnapshotMetadataTestJSON-2095417139 None] Created volume successfully. Apr 15 20:07:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ca103bd7-11e1-4365-a34f-9e44974652aa tempest-SnapshotMetadataTestJSON-2095417139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ca103bd7-11e1-4365-a34f-9e44974652aa tempest-SnapshotMetadataTestJSON-2095417139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:31 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-ca103bd7-11e1-4365-a34f-9e44974652aa tempest-SnapshotMetadataTestJSON-2095417139 None] Creating offline snapshot 6543215a-010b-4e1f-923f-6a07a3750a16 of volume 362eb034-d723-4dc3-8c0c-3def4341c228 {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:07:31 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[44eecd1f-87a0-4237-acd1-cf8ce168f6e1]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:07:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ca103bd7-11e1-4365-a34f-9e44974652aa tempest-SnapshotMetadataTestJSON-2095417139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:31 devstack sudo[85723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228 Apr 15 20:07:31 devstack sudo[85723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:31 devstack sudo[85723]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ca103bd7-11e1-4365-a34f-9e44974652aa tempest-SnapshotMetadataTestJSON-2095417139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228" returned: 0 in 0.485s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ca103bd7-11e1-4365-a34f-9e44974652aa tempest-SnapshotMetadataTestJSON-2095417139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.6543215a-010b-4e1f-923f-6a07a3750a16 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:31 devstack sudo[85728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.6543215a-010b-4e1f-923f-6a07a3750a16 1G Apr 15 20:07:31 devstack sudo[85728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:32 devstack sudo[85728]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ca103bd7-11e1-4365-a34f-9e44974652aa tempest-SnapshotMetadataTestJSON-2095417139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.6543215a-010b-4e1f-923f-6a07a3750a16 1G" returned: 0 in 0.635s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ca103bd7-11e1-4365-a34f-9e44974652aa tempest-SnapshotMetadataTestJSON-2095417139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-362eb034-d723-4dc3-8c0c-3def4341c228 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.6543215a-010b-4e1f-923f-6a07a3750a16 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:32 devstack sudo[85735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-362eb034-d723-4dc3-8c0c-3def4341c228 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.6543215a-010b-4e1f-923f-6a07a3750a16 Apr 15 20:07:32 devstack sudo[85735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:33 devstack sudo[85735]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ca103bd7-11e1-4365-a34f-9e44974652aa tempest-SnapshotMetadataTestJSON-2095417139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-362eb034-d723-4dc3-8c0c-3def4341c228 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.6543215a-010b-4e1f-923f-6a07a3750a16" returned: 0 in 0.507s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:33 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-ca103bd7-11e1-4365-a34f-9e44974652aa tempest-SnapshotMetadataTestJSON-2095417139 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.6543215a-010b-4e1f-923f-6a07a3750a16 is being set with open permissions: ugo+rw Apr 15 20:07:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ca103bd7-11e1-4365-a34f-9e44974652aa tempest-SnapshotMetadataTestJSON-2095417139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.6543215a-010b-4e1f-923f-6a07a3750a16 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:33 devstack sudo[85741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.6543215a-010b-4e1f-923f-6a07a3750a16 Apr 15 20:07:33 devstack sudo[85741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:33 devstack sudo[85741]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ca103bd7-11e1-4365-a34f-9e44974652aa tempest-SnapshotMetadataTestJSON-2095417139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.6543215a-010b-4e1f-923f-6a07a3750a16" returned: 0 in 0.506s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ca103bd7-11e1-4365-a34f-9e44974652aa tempest-SnapshotMetadataTestJSON-2095417139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:33 devstack sudo[85745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.info Apr 15 20:07:33 devstack sudo[85745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:34 devstack sudo[85745]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ca103bd7-11e1-4365-a34f-9e44974652aa tempest-SnapshotMetadataTestJSON-2095417139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.info" returned: 0 in 0.647s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:34 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-ca103bd7-11e1-4365-a34f-9e44974652aa tempest-SnapshotMetadataTestJSON-2095417139 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.info is being set with open permissions: ugo+rw Apr 15 20:07:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ca103bd7-11e1-4365-a34f-9e44974652aa tempest-SnapshotMetadataTestJSON-2095417139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:34 devstack sudo[85775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.info Apr 15 20:07:34 devstack sudo[85775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:34 devstack sudo[85775]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ca103bd7-11e1-4365-a34f-9e44974652aa tempest-SnapshotMetadataTestJSON-2095417139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.info" returned: 0 in 0.646s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ca103bd7-11e1-4365-a34f-9e44974652aa tempest-SnapshotMetadataTestJSON-2095417139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.522s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:34 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-ca103bd7-11e1-4365-a34f-9e44974652aa tempest-SnapshotMetadataTestJSON-2095417139 None] Create snapshot completed successfully Apr 15 20:07:36 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5a7dd6ab-aa8e-46ea-a0a7-e7381433001c tempest-SnapshotMetadataTestJSON-2095417139 None] Acquiring lock "cinder-6543215a-010b-4e1f-923f-6a07a3750a16-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:36 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5a7dd6ab-aa8e-46ea-a0a7-e7381433001c tempest-SnapshotMetadataTestJSON-2095417139 None] Lock "cinder-6543215a-010b-4e1f-923f-6a07a3750a16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:36 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5a7dd6ab-aa8e-46ea-a0a7-e7381433001c tempest-SnapshotMetadataTestJSON-2095417139 None] Acquiring lock "cinder-quobyte-362eb034-d723-4dc3-8c0c-3def4341c228" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:36 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5a7dd6ab-aa8e-46ea-a0a7-e7381433001c tempest-SnapshotMetadataTestJSON-2095417139 None] Lock "cinder-quobyte-362eb034-d723-4dc3-8c0c-3def4341c228" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:36 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5a7dd6ab-aa8e-46ea-a0a7-e7381433001c tempest-SnapshotMetadataTestJSON-2095417139 None] Acquiring lock "cinder-quobyte-6543215a-010b-4e1f-923f-6a07a3750a16" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:36 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5a7dd6ab-aa8e-46ea-a0a7-e7381433001c tempest-SnapshotMetadataTestJSON-2095417139 None] Lock "cinder-quobyte-6543215a-010b-4e1f-923f-6a07a3750a16" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:36 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-5a7dd6ab-aa8e-46ea-a0a7-e7381433001c tempest-SnapshotMetadataTestJSON-2095417139 None] Deleting offline snapshot 6543215a-010b-4e1f-923f-6a07a3750a16 of volume 362eb034-d723-4dc3-8c0c-3def4341c228 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:07:36 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-5a7dd6ab-aa8e-46ea-a0a7-e7381433001c tempest-SnapshotMetadataTestJSON-2095417139 None] snapshot_file for this snap is: volume-362eb034-d723-4dc3-8c0c-3def4341c228.6543215a-010b-4e1f-923f-6a07a3750a16 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:07:36 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[af50521c-efa3-4511-a6ca-1af87024962b]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:07:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a7dd6ab-aa8e-46ea-a0a7-e7381433001c tempest-SnapshotMetadataTestJSON-2095417139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.6543215a-010b-4e1f-923f-6a07a3750a16 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:36 devstack sudo[85806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.6543215a-010b-4e1f-923f-6a07a3750a16 Apr 15 20:07:36 devstack sudo[85806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:36 devstack sudo[85806]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a7dd6ab-aa8e-46ea-a0a7-e7381433001c tempest-SnapshotMetadataTestJSON-2095417139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.6543215a-010b-4e1f-923f-6a07a3750a16" returned: 0 in 0.712s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:36 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-5a7dd6ab-aa8e-46ea-a0a7-e7381433001c tempest-SnapshotMetadataTestJSON-2095417139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-362eb034-d723-4dc3-8c0c-3def4341c228(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:07:36 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[614810b9-d2f2-4d16-9eab-140a5275ad03]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:07:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a7dd6ab-aa8e-46ea-a0a7-e7381433001c tempest-SnapshotMetadataTestJSON-2095417139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:37 devstack sudo[85813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228 Apr 15 20:07:37 devstack sudo[85813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:37 devstack sudo[85813]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a7dd6ab-aa8e-46ea-a0a7-e7381433001c tempest-SnapshotMetadataTestJSON-2095417139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228" returned: 0 in 0.715s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a7dd6ab-aa8e-46ea-a0a7-e7381433001c tempest-SnapshotMetadataTestJSON-2095417139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.6543215a-010b-4e1f-923f-6a07a3750a16 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:37 devstack sudo[85837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.6543215a-010b-4e1f-923f-6a07a3750a16 Apr 15 20:07:37 devstack sudo[85837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:38 devstack sudo[85837]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a7dd6ab-aa8e-46ea-a0a7-e7381433001c tempest-SnapshotMetadataTestJSON-2095417139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.6543215a-010b-4e1f-923f-6a07a3750a16" returned: 0 in 0.767s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a7dd6ab-aa8e-46ea-a0a7-e7381433001c tempest-SnapshotMetadataTestJSON-2095417139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.6543215a-010b-4e1f-923f-6a07a3750a16 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:38 devstack sudo[85869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.6543215a-010b-4e1f-923f-6a07a3750a16 Apr 15 20:07:38 devstack sudo[85869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:38 devstack sudo[85869]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a7dd6ab-aa8e-46ea-a0a7-e7381433001c tempest-SnapshotMetadataTestJSON-2095417139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228.6543215a-010b-4e1f-923f-6a07a3750a16" returned: 0 in 0.481s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:38 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5a7dd6ab-aa8e-46ea-a0a7-e7381433001c tempest-SnapshotMetadataTestJSON-2095417139 None] Lock "cinder-quobyte-6543215a-010b-4e1f-923f-6a07a3750a16" released by "_delete_snapshot" :: held 2.787s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:38 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5a7dd6ab-aa8e-46ea-a0a7-e7381433001c tempest-SnapshotMetadataTestJSON-2095417139 None] Lock "cinder-quobyte-362eb034-d723-4dc3-8c0c-3def4341c228" released by "delete_snapshot" :: held 2.842s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:39 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-5a7dd6ab-aa8e-46ea-a0a7-e7381433001c tempest-SnapshotMetadataTestJSON-2095417139 None] Created reservations ['9d93a293-6271-4986-8e35-11fd8da7ff73', 'bae5ebfe-ba70-4e4d-b24b-e822cd3d7e02', 'c2d19fb7-4c9c-4c7b-9fb2-1c6ecca4636f', '224661e7-ee1d-4e97-a44e-61079370c84f'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:07:39 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-5a7dd6ab-aa8e-46ea-a0a7-e7381433001c tempest-SnapshotMetadataTestJSON-2095417139 None] Delete snapshot completed successfully. Apr 15 20:07:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5a7dd6ab-aa8e-46ea-a0a7-e7381433001c tempest-SnapshotMetadataTestJSON-2095417139 None] Lock "cinder-6543215a-010b-4e1f-923f-6a07a3750a16-delete_snapshot" released by "delete_snapshot" :: held 2.943s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-65ea08f9-df78-4302-9f68-19ad8e3b7d22 tempest-SnapshotMetadataTestJSON-2095417139 None] Acquiring lock "cinder-362eb034-d723-4dc3-8c0c-3def4341c228-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-65ea08f9-df78-4302-9f68-19ad8e3b7d22 tempest-SnapshotMetadataTestJSON-2095417139 None] Lock "cinder-362eb034-d723-4dc3-8c0c-3def4341c228-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-65ea08f9-df78-4302-9f68-19ad8e3b7d22 tempest-SnapshotMetadataTestJSON-2095417139 None] Acquiring lock "cinder-quobyte-362eb034-d723-4dc3-8c0c-3def4341c228" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-65ea08f9-df78-4302-9f68-19ad8e3b7d22 tempest-SnapshotMetadataTestJSON-2095417139 None] Lock "cinder-quobyte-362eb034-d723-4dc3-8c0c-3def4341c228" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:39 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[e429e667-7c90-4ebe-b96d-b3dac02e3b88]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:07:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-65ea08f9-df78-4302-9f68-19ad8e3b7d22 tempest-SnapshotMetadataTestJSON-2095417139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:39 devstack sudo[85899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228 Apr 15 20:07:39 devstack sudo[85899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:40 devstack sudo[85899]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-65ea08f9-df78-4302-9f68-19ad8e3b7d22 tempest-SnapshotMetadataTestJSON-2095417139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228" returned: 0 in 0.755s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-65ea08f9-df78-4302-9f68-19ad8e3b7d22 tempest-SnapshotMetadataTestJSON-2095417139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:40 devstack sudo[85927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228 Apr 15 20:07:40 devstack sudo[85927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:40 devstack sudo[85927]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-65ea08f9-df78-4302-9f68-19ad8e3b7d22 tempest-SnapshotMetadataTestJSON-2095417139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-362eb034-d723-4dc3-8c0c-3def4341c228" returned: 0 in 0.510s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:40 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-65ea08f9-df78-4302-9f68-19ad8e3b7d22 tempest-SnapshotMetadataTestJSON-2095417139 None] Lock "cinder-quobyte-362eb034-d723-4dc3-8c0c-3def4341c228" released by "delete_volume" :: held 1.314s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:40 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-65ea08f9-df78-4302-9f68-19ad8e3b7d22 tempest-SnapshotMetadataTestJSON-2095417139 None] Created reservations ['bae2b362-baed-4025-b0e1-8a2eea338358', 'ce30e4e1-1415-42b2-95b3-6c0043a922eb', '8461f7da-6a24-4cd8-be6e-321af2f4bf40', '05601494-3610-4164-ad89-71e1d413b050'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:07:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-65ea08f9-df78-4302-9f68-19ad8e3b7d22 tempest-SnapshotMetadataTestJSON-2095417139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-65ea08f9-df78-4302-9f68-19ad8e3b7d22 tempest-SnapshotMetadataTestJSON-2095417139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-65ea08f9-df78-4302-9f68-19ad8e3b7d22 tempest-SnapshotMetadataTestJSON-2095417139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:07:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-65ea08f9-df78-4302-9f68-19ad8e3b7d22 tempest-SnapshotMetadataTestJSON-2095417139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:07:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-65ea08f9-df78-4302-9f68-19ad8e3b7d22 tempest-SnapshotMetadataTestJSON-2095417139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-65ea08f9-df78-4302-9f68-19ad8e3b7d22 tempest-SnapshotMetadataTestJSON-2095417139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:40 devstack sudo[85931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:07:40 devstack sudo[85931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:41 devstack sudo[85931]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-65ea08f9-df78-4302-9f68-19ad8e3b7d22 tempest-SnapshotMetadataTestJSON-2095417139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.467s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-65ea08f9-df78-4302-9f68-19ad8e3b7d22 tempest-SnapshotMetadataTestJSON-2095417139 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:07:41 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-65ea08f9-df78-4302-9f68-19ad8e3b7d22 tempest-SnapshotMetadataTestJSON-2095417139 None] Deleted volume successfully. Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-65ea08f9-df78-4302-9f68-19ad8e3b7d22 tempest-SnapshotMetadataTestJSON-2095417139 None] Lock "cinder-362eb034-d723-4dc3-8c0c-3def4341c228-delete_volume" released by "delete_volume" :: held 2.025s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Flow 'volume_create_manager' (45954222-85e9-46b4-baeb-cf70c271e47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6202269c-04e9-4d5e-bfab-e6999ffc3feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6202269c-04e9-4d5e-bfab-e6999ffc3feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1199004661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9f1bfe-d704-4c76-83c6-2aeae3554cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15cfa07759ab42a0bc66c9cd718673d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:41Z,use_quota=True,user_id='2773b07ff8fa4d259312bc68b7142a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28297d73-cf37-4736-908b-c42cef9ca173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28297d73-cf37-4736-908b-c42cef9ca173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6bc4602-ad5c-4c75-8ed4-15b6eec164d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6bc4602-ad5c-4c75-8ed4-15b6eec164d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a9f1bfe-d704-4c76-83c6-2aeae3554cf0', 'volume_name': 'volume-6a9f1bfe-d704-4c76-83c6-2aeae3554cf0', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b556138-473b-4385-9f72-a642efb15422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b556138-473b-4385-9f72-a642efb15422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429d1195-2501-4c2f-82cc-3fe29788b2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:41 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Volume 6a9f1bfe-d704-4c76-83c6-2aeae3554cf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a9f1bfe-d704-4c76-83c6-2aeae3554cf0', 'volume_size': 1} Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1199004661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9f1bfe-d704-4c76-83c6-2aeae3554cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15cfa07759ab42a0bc66c9cd718673d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:41Z,use_quota=True,user_id='2773b07ff8fa4d259312bc68b7142a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Creating volume 6a9f1bfe-d704-4c76-83c6-2aeae3554cf0 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:07:41 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:07:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6a9f1bfe-d704-4c76-83c6-2aeae3554cf0 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:41 devstack sudo[85935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6a9f1bfe-d704-4c76-83c6-2aeae3554cf0 1073741824 Apr 15 20:07:41 devstack sudo[85935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:42 devstack sudo[85935]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6a9f1bfe-d704-4c76-83c6-2aeae3554cf0 1073741824" returned: 0 in 1.102s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6a9f1bfe-d704-4c76-83c6-2aeae3554cf0 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:42 devstack sudo[85942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6a9f1bfe-d704-4c76-83c6-2aeae3554cf0 Apr 15 20:07:42 devstack sudo[85942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:43 devstack sudo[85942]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6a9f1bfe-d704-4c76-83c6-2aeae3554cf0" returned: 0 in 0.577s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:07:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429d1195-2501-4c2f-82cc-3fe29788b2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a9f1bfe-d704-4c76-83c6-2aeae3554cf0', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e4970d-2bb3-4005-815a-98f355b36a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:43 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Volume volume-6a9f1bfe-d704-4c76-83c6-2aeae3554cf0 (6a9f1bfe-d704-4c76-83c6-2aeae3554cf0): created successfully Apr 15 20:07:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e4970d-2bb3-4005-815a-98f355b36a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Flow 'volume_create_manager' (45954222-85e9-46b4-baeb-cf70c271e47e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:07:43 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-1d62f8ee-c76b-4277-8b99-d89015f2346e tempest-ServersNegativeTestJSON-1690439075 None] Created volume successfully. Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Flow 'volume_create_manager' (310306da-fcf9-4a2a-b8c9-903251f03857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00d2d12-dbfb-4b7e-9efd-2338280864ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00d2d12-dbfb-4b7e-9efd-2338280864ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-306638767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a51c66ef-9924-4fe8-970c-dbc2188c4fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2b64c6c2ff49c79ec12c2c2d782b23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:45Z,use_quota=True,user_id='ba65920dfdb844e6a2e649edf3128eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7edd064-9493-42cc-bf44-3d9d548051af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7edd064-9493-42cc-bf44-3d9d548051af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e2f1aa-89c8-4abc-9a78-182e4cf2e9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e2f1aa-89c8-4abc-9a78-182e4cf2e9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a51c66ef-9924-4fe8-970c-dbc2188c4fb1', 'volume_name': 'volume-a51c66ef-9924-4fe8-970c-dbc2188c4fb1', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0714d3-2d20-408f-b021-474552be4cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0714d3-2d20-408f-b021-474552be4cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a335c6e2-1d80-4096-9d87-06dcc9f10822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:44 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Volume a51c66ef-9924-4fe8-970c-dbc2188c4fb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a51c66ef-9924-4fe8-970c-dbc2188c4fb1', 'volume_size': 1} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-306638767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a51c66ef-9924-4fe8-970c-dbc2188c4fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2b64c6c2ff49c79ec12c2c2d782b23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:45Z,use_quota=True,user_id='ba65920dfdb844e6a2e649edf3128eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Creating volume a51c66ef-9924-4fe8-970c-dbc2188c4fb1 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:07:44 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a51c66ef-9924-4fe8-970c-dbc2188c4fb1 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:44 devstack sudo[85969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a51c66ef-9924-4fe8-970c-dbc2188c4fb1 1073741824 Apr 15 20:07:44 devstack sudo[85969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Flow 'volume_create_manager' (92af66bb-9921-45af-a7a2-5459ef996919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (313af6b8-0def-42c4-90aa-5f5cc647bda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (313af6b8-0def-42c4-90aa-5f5cc647bda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-911196197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88fbac13-671f-489a-a0b8-18dc1d8df54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15cfa07759ab42a0bc66c9cd718673d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:45Z,use_quota=True,user_id='2773b07ff8fa4d259312bc68b7142a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f946269a-1fff-43cc-ad4e-a0307986657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f946269a-1fff-43cc-ad4e-a0307986657c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d363ede5-c3b0-4ad5-ad6b-4ecf3197ac82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d363ede5-c3b0-4ad5-ad6b-4ecf3197ac82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88fbac13-671f-489a-a0b8-18dc1d8df54d', 'volume_name': 'volume-88fbac13-671f-489a-a0b8-18dc1d8df54d', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ef3fb6-40bb-4508-9505-ea65166f03c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ef3fb6-40bb-4508-9505-ea65166f03c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd92e8c-b35d-40f2-b8f1-b1f46b9ed383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:44 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Volume 88fbac13-671f-489a-a0b8-18dc1d8df54d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88fbac13-671f-489a-a0b8-18dc1d8df54d', 'volume_size': 1} Apr 15 20:07:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:45 devstack sudo[85969]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a51c66ef-9924-4fe8-970c-dbc2188c4fb1 1073741824" returned: 0 in 0.584s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a51c66ef-9924-4fe8-970c-dbc2188c4fb1 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:45 devstack sudo[85976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a51c66ef-9924-4fe8-970c-dbc2188c4fb1 Apr 15 20:07:45 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:45 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a51c66ef-9924-4fe8-970c-dbc2188c4fb1" returned: 0 in 0.431s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:45 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:07:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.714s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:45 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-911196197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88fbac13-671f-489a-a0b8-18dc1d8df54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15cfa07759ab42a0bc66c9cd718673d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:45Z,use_quota=True,user_id='2773b07ff8fa4d259312bc68b7142a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:07:45 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Creating volume 88fbac13-671f-489a-a0b8-18dc1d8df54d {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:07:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:45 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:07:45 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:07:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:45 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:07:45 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:07:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88fbac13-671f-489a-a0b8-18dc1d8df54d 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a335c6e2-1d80-4096-9d87-06dcc9f10822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a51c66ef-9924-4fe8-970c-dbc2188c4fb1', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22713ed-1bdb-4c30-aada-edceeaeeed64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:45 devstack sudo[85979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88fbac13-671f-489a-a0b8-18dc1d8df54d 1073741824 Apr 15 20:07:45 devstack sudo[85979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:45 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Volume volume-a51c66ef-9924-4fe8-970c-dbc2188c4fb1 (a51c66ef-9924-4fe8-970c-dbc2188c4fb1): created successfully Apr 15 20:07:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22713ed-1bdb-4c30-aada-edceeaeeed64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Flow 'volume_create_manager' (310306da-fcf9-4a2a-b8c9-903251f03857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:07:45 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-e3d692d1-cc3b-4efc-bcdb-3003f512813c tempest-AbsoluteLimitsTests-2103576136 None] Created volume successfully. Apr 15 20:07:46 devstack sudo[85979]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88fbac13-671f-489a-a0b8-18dc1d8df54d 1073741824" returned: 0 in 0.510s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:46 devstack cinder-volume[82989]: INFO cinder.volume.manager [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-691a2888-743e-47a7-b08f-4c9e0d6210b1 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Terminate volume connection completed successfully. Apr 15 20:07:46 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-691a2888-743e-47a7-b08f-4c9e0d6210b1 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Deleting attachment 91bb8684-b032-40eb-82ac-86e415e7b007. {{(pid=82989) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 20:07:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88fbac13-671f-489a-a0b8-18dc1d8df54d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:46 devstack sudo[85985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88fbac13-671f-489a-a0b8-18dc1d8df54d Apr 15 20:07:46 devstack sudo[85985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:46 devstack sudo[85985]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88fbac13-671f-489a-a0b8-18dc1d8df54d" returned: 0 in 0.438s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:46 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:07:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:46 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd92e8c-b35d-40f2-b8f1-b1f46b9ed383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88fbac13-671f-489a-a0b8-18dc1d8df54d', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:46 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47bbe92a-1d27-46f8-86d5-0c6b55ad945a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:46 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Volume volume-88fbac13-671f-489a-a0b8-18dc1d8df54d (88fbac13-671f-489a-a0b8-18dc1d8df54d): created successfully Apr 15 20:07:46 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47bbe92a-1d27-46f8-86d5-0c6b55ad945a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:46 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Flow 'volume_create_manager' (92af66bb-9921-45af-a7a2-5459ef996919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:07:46 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-3b1b17b2-9f32-4c4b-a6cf-cb58c389d6a3 tempest-ServersNegativeTestJSON-1690439075 None] Created volume successfully. Apr 15 20:07:46 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d1a49fce-f152-4f6d-9da9-c4f4487df860 tempest-AbsoluteLimitsTests-2103576136 None] Acquiring lock "cinder-a51c66ef-9924-4fe8-970c-dbc2188c4fb1-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:46 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d1a49fce-f152-4f6d-9da9-c4f4487df860 tempest-AbsoluteLimitsTests-2103576136 None] Lock "cinder-a51c66ef-9924-4fe8-970c-dbc2188c4fb1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:46 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d1a49fce-f152-4f6d-9da9-c4f4487df860 tempest-AbsoluteLimitsTests-2103576136 None] Acquiring lock "cinder-quobyte-a51c66ef-9924-4fe8-970c-dbc2188c4fb1" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:46 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d1a49fce-f152-4f6d-9da9-c4f4487df860 tempest-AbsoluteLimitsTests-2103576136 None] Lock "cinder-quobyte-a51c66ef-9924-4fe8-970c-dbc2188c4fb1" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:46 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-a6e9b9fd-90fd-4e6f-941a-3431f0729444 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Acquiring lock "cinder-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:46 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e883aa-64da-4488-82ed-b266cedb1d37]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:07:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d1a49fce-f152-4f6d-9da9-c4f4487df860 tempest-AbsoluteLimitsTests-2103576136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a51c66ef-9924-4fe8-970c-dbc2188c4fb1 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:46 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-a6e9b9fd-90fd-4e6f-941a-3431f0729444 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "cinder-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:46 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-a6e9b9fd-90fd-4e6f-941a-3431f0729444 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Acquiring lock "cinder-quobyte-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:46 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-a6e9b9fd-90fd-4e6f-941a-3431f0729444 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "cinder-quobyte-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0" acquired by "delete_volume" :: waited 0.023s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:46 devstack sudo[85988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a51c66ef-9924-4fe8-970c-dbc2188c4fb1 Apr 15 20:07:46 devstack sudo[85988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:46 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[79811dc5-011e-4e21-ab44-a582c64e8774]: (4, 'raw') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:07:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-a6e9b9fd-90fd-4e6f-941a-3431f0729444 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:47 devstack sudo[85990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 Apr 15 20:07:47 devstack sudo[85990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:47 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d809bc1b-fe69-4563-8655-7e8c04f4faba tempest-ServersNegativeTestJSON-1690439075 None] Acquiring lock "cinder-88fbac13-671f-489a-a0b8-18dc1d8df54d-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:47 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d809bc1b-fe69-4563-8655-7e8c04f4faba tempest-ServersNegativeTestJSON-1690439075 None] Lock "cinder-88fbac13-671f-489a-a0b8-18dc1d8df54d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:47 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d809bc1b-fe69-4563-8655-7e8c04f4faba tempest-ServersNegativeTestJSON-1690439075 None] Acquiring lock "cinder-quobyte-88fbac13-671f-489a-a0b8-18dc1d8df54d" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:47 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d809bc1b-fe69-4563-8655-7e8c04f4faba tempest-ServersNegativeTestJSON-1690439075 None] Lock "cinder-quobyte-88fbac13-671f-489a-a0b8-18dc1d8df54d" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:47 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[94382e03-2306-450b-a67a-d7cddf4fc5ce]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:07:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d809bc1b-fe69-4563-8655-7e8c04f4faba tempest-ServersNegativeTestJSON-1690439075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88fbac13-671f-489a-a0b8-18dc1d8df54d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:47 devstack sudo[85992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88fbac13-671f-489a-a0b8-18dc1d8df54d Apr 15 20:07:47 devstack sudo[85992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:47 devstack sudo[85988]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d1a49fce-f152-4f6d-9da9-c4f4487df860 tempest-AbsoluteLimitsTests-2103576136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a51c66ef-9924-4fe8-970c-dbc2188c4fb1" returned: 0 in 0.732s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d1a49fce-f152-4f6d-9da9-c4f4487df860 tempest-AbsoluteLimitsTests-2103576136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a51c66ef-9924-4fe8-970c-dbc2188c4fb1 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:47 devstack sudo[86000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a51c66ef-9924-4fe8-970c-dbc2188c4fb1 Apr 15 20:07:47 devstack sudo[86000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:47 devstack sudo[85990]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-a6e9b9fd-90fd-4e6f-941a-3431f0729444 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0" returned: 0 in 0.677s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-a6e9b9fd-90fd-4e6f-941a-3431f0729444 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:47 devstack sudo[86002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 Apr 15 20:07:47 devstack sudo[86002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:47 devstack sudo[85992]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d809bc1b-fe69-4563-8655-7e8c04f4faba tempest-ServersNegativeTestJSON-1690439075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88fbac13-671f-489a-a0b8-18dc1d8df54d" returned: 0 in 0.599s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d809bc1b-fe69-4563-8655-7e8c04f4faba tempest-ServersNegativeTestJSON-1690439075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88fbac13-671f-489a-a0b8-18dc1d8df54d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:47 devstack sudo[86007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88fbac13-671f-489a-a0b8-18dc1d8df54d Apr 15 20:07:47 devstack sudo[86007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:48 devstack sudo[86000]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d1a49fce-f152-4f6d-9da9-c4f4487df860 tempest-AbsoluteLimitsTests-2103576136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a51c66ef-9924-4fe8-970c-dbc2188c4fb1" returned: 0 in 0.448s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d1a49fce-f152-4f6d-9da9-c4f4487df860 tempest-AbsoluteLimitsTests-2103576136 None] Lock "cinder-quobyte-a51c66ef-9924-4fe8-970c-dbc2188c4fb1" released by "delete_volume" :: held 1.224s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-d1a49fce-f152-4f6d-9da9-c4f4487df860 tempest-AbsoluteLimitsTests-2103576136 None] Created reservations ['285ecbf5-2ce5-4a7b-b4fb-5e3e75b3a16c', 'cc069c59-d013-43c3-88e6-03111fef25f5', 'c00a3c84-ab43-4660-8899-0cdd200ed5f6', 'c40c9081-a12e-49c0-ac8e-a1c7fcb77c91'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d1a49fce-f152-4f6d-9da9-c4f4487df860 tempest-AbsoluteLimitsTests-2103576136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d1a49fce-f152-4f6d-9da9-c4f4487df860 tempest-AbsoluteLimitsTests-2103576136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d1a49fce-f152-4f6d-9da9-c4f4487df860 tempest-AbsoluteLimitsTests-2103576136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d1a49fce-f152-4f6d-9da9-c4f4487df860 tempest-AbsoluteLimitsTests-2103576136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d1a49fce-f152-4f6d-9da9-c4f4487df860 tempest-AbsoluteLimitsTests-2103576136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d1a49fce-f152-4f6d-9da9-c4f4487df860 tempest-AbsoluteLimitsTests-2103576136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:48 devstack sudo[86013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:07:48 devstack sudo[86013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:48 devstack sudo[86002]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-a6e9b9fd-90fd-4e6f-941a-3431f0729444 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0" returned: 1 in 0.533s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-a6e9b9fd-90fd-4e6f-941a-3431f0729444 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0' failed. Not Retrying. {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-a6e9b9fd-90fd-4e6f-941a-3431f0729444 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:48 devstack sudo[86015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0 Apr 15 20:07:48 devstack sudo[86015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:48 devstack sudo[86007]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d809bc1b-fe69-4563-8655-7e8c04f4faba tempest-ServersNegativeTestJSON-1690439075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88fbac13-671f-489a-a0b8-18dc1d8df54d" returned: 0 in 0.497s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d809bc1b-fe69-4563-8655-7e8c04f4faba tempest-ServersNegativeTestJSON-1690439075 None] Lock "cinder-quobyte-88fbac13-671f-489a-a0b8-18dc1d8df54d" released by "delete_volume" :: held 1.118s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-d809bc1b-fe69-4563-8655-7e8c04f4faba tempest-ServersNegativeTestJSON-1690439075 None] Created reservations ['b14322c6-6641-442f-af92-4c24b53689f3', 'bfad3754-8c79-4bea-b84b-f29b84677792', '4ab8f9f3-f181-4a58-be2a-4483195bf34b', '020f6b88-3af9-41ea-8b2b-9bf294e96a2a'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d809bc1b-fe69-4563-8655-7e8c04f4faba tempest-ServersNegativeTestJSON-1690439075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d809bc1b-fe69-4563-8655-7e8c04f4faba tempest-ServersNegativeTestJSON-1690439075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d809bc1b-fe69-4563-8655-7e8c04f4faba tempest-ServersNegativeTestJSON-1690439075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d809bc1b-fe69-4563-8655-7e8c04f4faba tempest-ServersNegativeTestJSON-1690439075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d809bc1b-fe69-4563-8655-7e8c04f4faba tempest-ServersNegativeTestJSON-1690439075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d809bc1b-fe69-4563-8655-7e8c04f4faba tempest-ServersNegativeTestJSON-1690439075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:48 devstack sudo[86019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:07:48 devstack sudo[86019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:48 devstack sudo[86013]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d1a49fce-f152-4f6d-9da9-c4f4487df860 tempest-AbsoluteLimitsTests-2103576136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.512s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-d1a49fce-f152-4f6d-9da9-c4f4487df860 tempest-AbsoluteLimitsTests-2103576136 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:07:48 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-d1a49fce-f152-4f6d-9da9-c4f4487df860 tempest-AbsoluteLimitsTests-2103576136 None] Deleted volume successfully. Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d1a49fce-f152-4f6d-9da9-c4f4487df860 tempest-AbsoluteLimitsTests-2103576136 None] Lock "cinder-a51c66ef-9924-4fe8-970c-dbc2188c4fb1-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:48 devstack sudo[86015]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-a6e9b9fd-90fd-4e6f-941a-3431f0729444 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0" returned: 0 in 0.503s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-a6e9b9fd-90fd-4e6f-941a-3431f0729444 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "cinder-quobyte-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0" released by "delete_volume" :: held 1.781s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG cinder.quota [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-a6e9b9fd-90fd-4e6f-941a-3431f0729444 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Created reservations ['3d5336de-6f18-4da2-8820-c7ef0191b452', 'ebaf4801-724f-43d8-974d-34cbeddb317b', '359a0dcc-496e-45ff-9ba5-d679cb5991e4', '52f1ff94-3e7f-41fe-ac54-a23bd8cb77ab'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-a6e9b9fd-90fd-4e6f-941a-3431f0729444 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-a6e9b9fd-90fd-4e6f-941a-3431f0729444 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-a6e9b9fd-90fd-4e6f-941a-3431f0729444 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-a6e9b9fd-90fd-4e6f-941a-3431f0729444 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-a6e9b9fd-90fd-4e6f-941a-3431f0729444 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-a6e9b9fd-90fd-4e6f-941a-3431f0729444 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:48 devstack sudo[86022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:07:48 devstack sudo[86022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:49 devstack sudo[86019]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d809bc1b-fe69-4563-8655-7e8c04f4faba tempest-ServersNegativeTestJSON-1690439075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.538s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:49 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-d809bc1b-fe69-4563-8655-7e8c04f4faba tempest-ServersNegativeTestJSON-1690439075 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:07:49 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-d809bc1b-fe69-4563-8655-7e8c04f4faba tempest-ServersNegativeTestJSON-1690439075 None] Deleted volume successfully. Apr 15 20:07:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d809bc1b-fe69-4563-8655-7e8c04f4faba tempest-ServersNegativeTestJSON-1690439075 None] Lock "cinder-88fbac13-671f-489a-a0b8-18dc1d8df54d-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:49 devstack sudo[86022]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-a6e9b9fd-90fd-4e6f-941a-3431f0729444 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.482s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:49 devstack cinder-volume[82989]: DEBUG cinder.manager [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-a6e9b9fd-90fd-4e6f-941a-3431f0729444 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:07:49 devstack cinder-volume[82989]: INFO cinder.volume.manager [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-a6e9b9fd-90fd-4e6f-941a-3431f0729444 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Deleted volume successfully. Apr 15 20:07:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-702e295c-9d94-4339-ad07-22c661e1b3fb req-a6e9b9fd-90fd-4e6f-941a-3431f0729444 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "cinder-ba3fc91f-ffc4-4645-96e1-481fcbfae4d0-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-06eb3e4c-3785-4501-a371-d750adbc14d3 tempest-ServersNegativeTestJSON-1690439075 None] Acquiring lock "cinder-6a9f1bfe-d704-4c76-83c6-2aeae3554cf0-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-06eb3e4c-3785-4501-a371-d750adbc14d3 tempest-ServersNegativeTestJSON-1690439075 None] Lock "cinder-6a9f1bfe-d704-4c76-83c6-2aeae3554cf0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-06eb3e4c-3785-4501-a371-d750adbc14d3 tempest-ServersNegativeTestJSON-1690439075 None] Acquiring lock "cinder-quobyte-6a9f1bfe-d704-4c76-83c6-2aeae3554cf0" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-06eb3e4c-3785-4501-a371-d750adbc14d3 tempest-ServersNegativeTestJSON-1690439075 None] Lock "cinder-quobyte-6a9f1bfe-d704-4c76-83c6-2aeae3554cf0" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:49 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d28155-0cdf-4366-bdc9-c363dd26ddf7]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:07:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-06eb3e4c-3785-4501-a371-d750adbc14d3 tempest-ServersNegativeTestJSON-1690439075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6a9f1bfe-d704-4c76-83c6-2aeae3554cf0 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:49 devstack sudo[86026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6a9f1bfe-d704-4c76-83c6-2aeae3554cf0 Apr 15 20:07:49 devstack sudo[86026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:50 devstack sudo[86026]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-06eb3e4c-3785-4501-a371-d750adbc14d3 tempest-ServersNegativeTestJSON-1690439075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6a9f1bfe-d704-4c76-83c6-2aeae3554cf0" returned: 0 in 0.601s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-06eb3e4c-3785-4501-a371-d750adbc14d3 tempest-ServersNegativeTestJSON-1690439075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6a9f1bfe-d704-4c76-83c6-2aeae3554cf0 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:50 devstack sudo[86032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6a9f1bfe-d704-4c76-83c6-2aeae3554cf0 Apr 15 20:07:50 devstack sudo[86032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:50 devstack sudo[86032]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-06eb3e4c-3785-4501-a371-d750adbc14d3 tempest-ServersNegativeTestJSON-1690439075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6a9f1bfe-d704-4c76-83c6-2aeae3554cf0" returned: 0 in 0.466s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:50 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-06eb3e4c-3785-4501-a371-d750adbc14d3 tempest-ServersNegativeTestJSON-1690439075 None] Lock "cinder-quobyte-6a9f1bfe-d704-4c76-83c6-2aeae3554cf0" released by "delete_volume" :: held 1.089s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:50 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-06eb3e4c-3785-4501-a371-d750adbc14d3 tempest-ServersNegativeTestJSON-1690439075 None] Created reservations ['ed2ff382-bfdd-4fc6-b516-f6b254d7c3a2', '6a88c848-2036-45ca-8ca0-baf8be5c57b1', '75941808-b604-45a9-af45-ea1d75245d6d', '69fa6899-e518-442e-b5c6-f274ecf0b7ea'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:07:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-06eb3e4c-3785-4501-a371-d750adbc14d3 tempest-ServersNegativeTestJSON-1690439075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-06eb3e4c-3785-4501-a371-d750adbc14d3 tempest-ServersNegativeTestJSON-1690439075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:50 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-06eb3e4c-3785-4501-a371-d750adbc14d3 tempest-ServersNegativeTestJSON-1690439075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:07:50 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-06eb3e4c-3785-4501-a371-d750adbc14d3 tempest-ServersNegativeTestJSON-1690439075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:07:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-06eb3e4c-3785-4501-a371-d750adbc14d3 tempest-ServersNegativeTestJSON-1690439075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-06eb3e4c-3785-4501-a371-d750adbc14d3 tempest-ServersNegativeTestJSON-1690439075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:50 devstack sudo[86035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:07:50 devstack sudo[86035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:51 devstack sudo[86035]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-06eb3e4c-3785-4501-a371-d750adbc14d3 tempest-ServersNegativeTestJSON-1690439075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.479s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-06eb3e4c-3785-4501-a371-d750adbc14d3 tempest-ServersNegativeTestJSON-1690439075 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:07:51 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-06eb3e4c-3785-4501-a371-d750adbc14d3 tempest-ServersNegativeTestJSON-1690439075 None] Deleted volume successfully. Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-06eb3e4c-3785-4501-a371-d750adbc14d3 tempest-ServersNegativeTestJSON-1690439075 None] Lock "cinder-6a9f1bfe-d704-4c76-83c6-2aeae3554cf0-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Flow 'volume_create_manager' (c75c91fe-00e7-4794-bf7f-78333a086e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (894e811e-93c6-419d-adb2-b3155dce8f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (894e811e-93c6-419d-adb2-b3155dce8f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1646204689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb623f3e-3ca6-4648-aae4-119a1c3b6d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db06a38e9e134e5ca24d080dc8d28292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:52Z,use_quota=True,user_id='82208a69e96745389d525ae9357dfe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41afe74c-604a-4b3a-9b44-5cc4c577ccc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41afe74c-604a-4b3a-9b44-5cc4c577ccc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb39d0b8-bca9-430b-b7f7-addc582c5d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb39d0b8-bca9-430b-b7f7-addc582c5d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb623f3e-3ca6-4648-aae4-119a1c3b6d3a', 'volume_name': 'volume-cb623f3e-3ca6-4648-aae4-119a1c3b6d3a', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d6f9b0-2c66-4721-bae8-b751fcb0067f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d6f9b0-2c66-4721-bae8-b751fcb0067f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (465180bb-de87-44da-b794-3e2dad09a638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:51 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Volume cb623f3e-3ca6-4648-aae4-119a1c3b6d3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb623f3e-3ca6-4648-aae4-119a1c3b6d3a', 'volume_size': 1} Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1646204689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb623f3e-3ca6-4648-aae4-119a1c3b6d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db06a38e9e134e5ca24d080dc8d28292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:52Z,use_quota=True,user_id='82208a69e96745389d525ae9357dfe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Creating volume cb623f3e-3ca6-4648-aae4-119a1c3b6d3a {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:07:51 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:07:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cb623f3e-3ca6-4648-aae4-119a1c3b6d3a 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:51 devstack sudo[86066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cb623f3e-3ca6-4648-aae4-119a1c3b6d3a 1073741824 Apr 15 20:07:51 devstack sudo[86066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:52 devstack sudo[86066]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cb623f3e-3ca6-4648-aae4-119a1c3b6d3a 1073741824" returned: 0 in 0.517s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cb623f3e-3ca6-4648-aae4-119a1c3b6d3a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:52 devstack sudo[86073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cb623f3e-3ca6-4648-aae4-119a1c3b6d3a Apr 15 20:07:52 devstack sudo[86073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:52 devstack sudo[86073]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cb623f3e-3ca6-4648-aae4-119a1c3b6d3a" returned: 0 in 0.446s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:52 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:07:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (465180bb-de87-44da-b794-3e2dad09a638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb623f3e-3ca6-4648-aae4-119a1c3b6d3a', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f5275fd-1ea0-4c18-bbf1-dbbc1fdb3841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:52 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Volume volume-cb623f3e-3ca6-4648-aae4-119a1c3b6d3a (cb623f3e-3ca6-4648-aae4-119a1c3b6d3a): created successfully Apr 15 20:07:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f5275fd-1ea0-4c18-bbf1-dbbc1fdb3841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Flow 'volume_create_manager' (c75c91fe-00e7-4794-bf7f-78333a086e5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:07:52 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-0cd004bf-0c90-4ba4-adc2-5388d2aaaf64 tempest-VolumesMetadataTest-665187324 None] Created volume successfully. Apr 15 20:07:54 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ab860c4c-c586-4c75-b8f7-f964836fc742 tempest-VolumesMetadataTest-665187324 None] Acquiring lock "cinder-cb623f3e-3ca6-4648-aae4-119a1c3b6d3a-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:54 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ab860c4c-c586-4c75-b8f7-f964836fc742 tempest-VolumesMetadataTest-665187324 None] Lock "cinder-cb623f3e-3ca6-4648-aae4-119a1c3b6d3a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:54 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ab860c4c-c586-4c75-b8f7-f964836fc742 tempest-VolumesMetadataTest-665187324 None] Acquiring lock "cinder-quobyte-cb623f3e-3ca6-4648-aae4-119a1c3b6d3a" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:07:54 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ab860c4c-c586-4c75-b8f7-f964836fc742 tempest-VolumesMetadataTest-665187324 None] Lock "cinder-quobyte-cb623f3e-3ca6-4648-aae4-119a1c3b6d3a" acquired by "delete_volume" :: waited 0.012s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:07:54 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e808eae-b93c-4d5b-9598-8353ccb0ba8d]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:07:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ab860c4c-c586-4c75-b8f7-f964836fc742 tempest-VolumesMetadataTest-665187324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cb623f3e-3ca6-4648-aae4-119a1c3b6d3a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:54 devstack sudo[86101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cb623f3e-3ca6-4648-aae4-119a1c3b6d3a Apr 15 20:07:54 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:54 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ab860c4c-c586-4c75-b8f7-f964836fc742 tempest-VolumesMetadataTest-665187324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cb623f3e-3ca6-4648-aae4-119a1c3b6d3a" returned: 0 in 0.534s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ab860c4c-c586-4c75-b8f7-f964836fc742 tempest-VolumesMetadataTest-665187324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cb623f3e-3ca6-4648-aae4-119a1c3b6d3a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:54 devstack sudo[86107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cb623f3e-3ca6-4648-aae4-119a1c3b6d3a Apr 15 20:07:54 devstack sudo[86107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:55 devstack sudo[86107]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ab860c4c-c586-4c75-b8f7-f964836fc742 tempest-VolumesMetadataTest-665187324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cb623f3e-3ca6-4648-aae4-119a1c3b6d3a" returned: 0 in 0.460s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:55 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ab860c4c-c586-4c75-b8f7-f964836fc742 tempest-VolumesMetadataTest-665187324 None] Lock "cinder-quobyte-cb623f3e-3ca6-4648-aae4-119a1c3b6d3a" released by "delete_volume" :: held 1.017s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:55 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-ab860c4c-c586-4c75-b8f7-f964836fc742 tempest-VolumesMetadataTest-665187324 None] Created reservations ['8f3e84bf-8f05-480f-bcd0-25e90b7c6262', 'e1c047a4-7ae6-4191-9430-c8fc47243157', 'e79eea63-7ecc-4dcd-adf1-6a33eec58fe7', 'b606c26a-9bb2-4e34-bfe3-8eb583a2ecd4'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:07:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ab860c4c-c586-4c75-b8f7-f964836fc742 tempest-VolumesMetadataTest-665187324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ab860c4c-c586-4c75-b8f7-f964836fc742 tempest-VolumesMetadataTest-665187324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ab860c4c-c586-4c75-b8f7-f964836fc742 tempest-VolumesMetadataTest-665187324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:07:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ab860c4c-c586-4c75-b8f7-f964836fc742 tempest-VolumesMetadataTest-665187324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:07:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ab860c4c-c586-4c75-b8f7-f964836fc742 tempest-VolumesMetadataTest-665187324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ab860c4c-c586-4c75-b8f7-f964836fc742 tempest-VolumesMetadataTest-665187324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:55 devstack sudo[86111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:07:55 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:55 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ab860c4c-c586-4c75-b8f7-f964836fc742 tempest-VolumesMetadataTest-665187324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.426s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:55 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-ab860c4c-c586-4c75-b8f7-f964836fc742 tempest-VolumesMetadataTest-665187324 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:07:55 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-ab860c4c-c586-4c75-b8f7-f964836fc742 tempest-VolumesMetadataTest-665187324 None] Deleted volume successfully. Apr 15 20:07:55 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ab860c4c-c586-4c75-b8f7-f964836fc742 tempest-VolumesMetadataTest-665187324 None] Lock "cinder-cb623f3e-3ca6-4648-aae4-119a1c3b6d3a-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:07:58 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:07:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Flow 'volume_create_manager' (d4b11a74-ed50-4a76-8cd4-e197aca4d37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:07:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3dc9c5b-ab57-4665-8e05-a258e58eaba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3dc9c5b-ab57-4665-8e05-a258e58eaba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-229551721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3d978f6-f5dd-4146-ae97-bf49a1b11417,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e827dca35b45461d958ad9e8cf1ad1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:58Z,use_quota=True,user_id='b2cefbbe44fe47418192b0b2d636c965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150da8de-fc67-4f29-8389-a7b4fcc4c272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150da8de-fc67-4f29-8389-a7b4fcc4c272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (176cc879-1d51-43f2-a741-eff8c3be031c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (176cc879-1d51-43f2-a741-eff8c3be031c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3d978f6-f5dd-4146-ae97-bf49a1b11417', 'volume_name': 'volume-b3d978f6-f5dd-4146-ae97-bf49a1b11417', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f32c0a-4120-4c35-a109-aa013583656d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f32c0a-4120-4c35-a109-aa013583656d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16127b9-9aae-4b64-a162-ce258e8a2253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:58 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Volume b3d978f6-f5dd-4146-ae97-bf49a1b11417: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3d978f6-f5dd-4146-ae97-bf49a1b11417', 'volume_size': 1} Apr 15 20:07:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:58 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-229551721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3d978f6-f5dd-4146-ae97-bf49a1b11417,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e827dca35b45461d958ad9e8cf1ad1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:07:58Z,use_quota=True,user_id='b2cefbbe44fe47418192b0b2d636c965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:07:58 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Creating volume b3d978f6-f5dd-4146-ae97-bf49a1b11417 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:07:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:07:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:07:58 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:07:58 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:07:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:58 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:07:58 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:07:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3d978f6-f5dd-4146-ae97-bf49a1b11417 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:58 devstack sudo[86143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3d978f6-f5dd-4146-ae97-bf49a1b11417 1073741824 Apr 15 20:07:58 devstack sudo[86143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:58 devstack sudo[86143]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3d978f6-f5dd-4146-ae97-bf49a1b11417 1073741824" returned: 0 in 0.556s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3d978f6-f5dd-4146-ae97-bf49a1b11417 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:07:59 devstack sudo[86150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3d978f6-f5dd-4146-ae97-bf49a1b11417 Apr 15 20:07:59 devstack sudo[86150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:07:59 devstack sudo[86150]: pam_unix(sudo:session): session closed for user root Apr 15 20:07:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3d978f6-f5dd-4146-ae97-bf49a1b11417" returned: 0 in 0.504s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:07:59 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:07:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:07:59 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16127b9-9aae-4b64-a162-ce258e8a2253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3d978f6-f5dd-4146-ae97-bf49a1b11417', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:59 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0172b39-fd0d-469b-9e1f-b68236ed5f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:07:59 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Volume volume-b3d978f6-f5dd-4146-ae97-bf49a1b11417 (b3d978f6-f5dd-4146-ae97-bf49a1b11417): created successfully Apr 15 20:07:59 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0172b39-fd0d-469b-9e1f-b68236ed5f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:07:59 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Flow 'volume_create_manager' (d4b11a74-ed50-4a76-8cd4-e197aca4d37c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:07:59 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-05f23bed-4ce8-4964-b20a-d7b76f8ae000 tempest-VolumesGetTest-1330055057 None] Created volume successfully. Apr 15 20:08:00 devstack cinder-volume[82989]: INFO cinder.volume.manager [req-fe40d20e-cc08-4920-94d9-673ff8c1186c req-51f29004-7247-402d-9f61-2a1daaa444a9 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Terminate volume connection completed successfully. Apr 15 20:08:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-fe40d20e-cc08-4920-94d9-673ff8c1186c req-51f29004-7247-402d-9f61-2a1daaa444a9 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Deleting attachment 531f8804-f726-4e4e-b616-b3b26fd0e717. {{(pid=82989) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 20:08:00 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-fe40d20e-cc08-4920-94d9-673ff8c1186c req-e8bfcfdf-3a1e-4de3-b203-ff264344d3e0 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Acquiring lock "cinder-1158390f-3495-4599-8c27-213e61b83aa8-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:08:00 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-fe40d20e-cc08-4920-94d9-673ff8c1186c req-e8bfcfdf-3a1e-4de3-b203-ff264344d3e0 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "cinder-1158390f-3495-4599-8c27-213e61b83aa8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:08:00 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-fe40d20e-cc08-4920-94d9-673ff8c1186c req-e8bfcfdf-3a1e-4de3-b203-ff264344d3e0 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Acquiring lock "cinder-quobyte-1158390f-3495-4599-8c27-213e61b83aa8" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:08:00 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-fe40d20e-cc08-4920-94d9-673ff8c1186c req-e8bfcfdf-3a1e-4de3-b203-ff264344d3e0 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "cinder-quobyte-1158390f-3495-4599-8c27-213e61b83aa8" acquired by "delete_volume" :: waited 0.017s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:08:00 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ad47d9-6eb1-4f20-935d-4cd86136d095]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-fe40d20e-cc08-4920-94d9-673ff8c1186c req-e8bfcfdf-3a1e-4de3-b203-ff264344d3e0 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1158390f-3495-4599-8c27-213e61b83aa8 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:00 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:08:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Flow 'volume_create_manager' (2cf9a4e6-d366-4d58-9e06-c91624e930f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:08:00 devstack sudo[86163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1158390f-3495-4599-8c27-213e61b83aa8 Apr 15 20:08:00 devstack sudo[86163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1343040-2cba-4645-9463-10afa18885be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1343040-2cba-4645-9463-10afa18885be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:08:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1293865451',display_name='tempest-VolumesGetTest-Volume-2097196744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ee316d-fe7c-4270-8c03-cb97adee4f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e827dca35b45461d958ad9e8cf1ad1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:01Z,use_quota=True,user_id='b2cefbbe44fe47418192b0b2d636c965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:01 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70401ae7-8b12-4023-b180-e0d0fb20e79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:01 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70401ae7-8b12-4023-b180-e0d0fb20e79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:01 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e19dfc3-52be-4e64-b2d4-48a33f36e329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:01 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e19dfc3-52be-4e64-b2d4-48a33f36e329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64ee316d-fe7c-4270-8c03-cb97adee4f40', 'volume_name': 'volume-64ee316d-fe7c-4270-8c03-cb97adee4f40', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:01 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376b17f9-37a8-4703-b699-51108a13fc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:01 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376b17f9-37a8-4703-b699-51108a13fc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:01 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5aea8ad-3de7-425c-a087-92bbede05b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:01 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Volume 64ee316d-fe7c-4270-8c03-cb97adee4f40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64ee316d-fe7c-4270-8c03-cb97adee4f40', 'volume_size': 1} Apr 15 20:08:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:01 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:08:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1293865451',display_name='tempest-VolumesGetTest-Volume-2097196744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ee316d-fe7c-4270-8c03-cb97adee4f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e827dca35b45461d958ad9e8cf1ad1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:01Z,use_quota=True,user_id='b2cefbbe44fe47418192b0b2d636c965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:08:01 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Creating volume 64ee316d-fe7c-4270-8c03-cb97adee4f40 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:08:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:01 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:08:01 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:08:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:01 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:08:01 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:08:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-64ee316d-fe7c-4270-8c03-cb97adee4f40 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:01 devstack sudo[86165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-64ee316d-fe7c-4270-8c03-cb97adee4f40 1073741824 Apr 15 20:08:01 devstack sudo[86165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:01 devstack sudo[86163]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-fe40d20e-cc08-4920-94d9-673ff8c1186c req-e8bfcfdf-3a1e-4de3-b203-ff264344d3e0 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1158390f-3495-4599-8c27-213e61b83aa8" returned: 0 in 0.684s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-fe40d20e-cc08-4920-94d9-673ff8c1186c req-e8bfcfdf-3a1e-4de3-b203-ff264344d3e0 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1158390f-3495-4599-8c27-213e61b83aa8 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:01 devstack sudo[86173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1158390f-3495-4599-8c27-213e61b83aa8 Apr 15 20:08:01 devstack sudo[86173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:01 devstack sudo[86165]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-64ee316d-fe7c-4270-8c03-cb97adee4f40 1073741824" returned: 0 in 0.581s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-64ee316d-fe7c-4270-8c03-cb97adee4f40 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:01 devstack sudo[86175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-64ee316d-fe7c-4270-8c03-cb97adee4f40 Apr 15 20:08:01 devstack sudo[86175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:02 devstack sudo[86173]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-fe40d20e-cc08-4920-94d9-673ff8c1186c req-e8bfcfdf-3a1e-4de3-b203-ff264344d3e0 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1158390f-3495-4599-8c27-213e61b83aa8" returned: 0 in 0.494s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:02 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-fe40d20e-cc08-4920-94d9-673ff8c1186c req-e8bfcfdf-3a1e-4de3-b203-ff264344d3e0 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "cinder-quobyte-1158390f-3495-4599-8c27-213e61b83aa8" released by "delete_volume" :: held 1.227s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:08:02 devstack cinder-volume[82989]: DEBUG cinder.quota [req-fe40d20e-cc08-4920-94d9-673ff8c1186c req-e8bfcfdf-3a1e-4de3-b203-ff264344d3e0 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Created reservations ['a8f6c33d-99ae-48a3-ac4e-3f76fda663fa', '1f43b8e8-2c38-4d7c-9b75-e91798df8c5b', '62c22ae5-5b99-4840-b151-ed0ffb776314', 'fa596501-58d9-4f75-b7a6-2fd3ef239d90'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:08:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-fe40d20e-cc08-4920-94d9-673ff8c1186c req-e8bfcfdf-3a1e-4de3-b203-ff264344d3e0 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-fe40d20e-cc08-4920-94d9-673ff8c1186c req-e8bfcfdf-3a1e-4de3-b203-ff264344d3e0 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:02 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-fe40d20e-cc08-4920-94d9-673ff8c1186c req-e8bfcfdf-3a1e-4de3-b203-ff264344d3e0 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:08:02 devstack sudo[86175]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:02 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-fe40d20e-cc08-4920-94d9-673ff8c1186c req-e8bfcfdf-3a1e-4de3-b203-ff264344d3e0 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:08:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-fe40d20e-cc08-4920-94d9-673ff8c1186c req-e8bfcfdf-3a1e-4de3-b203-ff264344d3e0 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-fe40d20e-cc08-4920-94d9-673ff8c1186c req-e8bfcfdf-3a1e-4de3-b203-ff264344d3e0 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-64ee316d-fe7c-4270-8c03-cb97adee4f40" returned: 0 in 0.546s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:02 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:08:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:02 devstack sudo[86180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:08:02 devstack sudo[86180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5aea8ad-3de7-425c-a087-92bbede05b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64ee316d-fe7c-4270-8c03-cb97adee4f40', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d21d31-c8b9-4405-b3de-e0757bf8c32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:02 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Volume volume-64ee316d-fe7c-4270-8c03-cb97adee4f40 (64ee316d-fe7c-4270-8c03-cb97adee4f40): created successfully Apr 15 20:08:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d21d31-c8b9-4405-b3de-e0757bf8c32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Flow 'volume_create_manager' (2cf9a4e6-d366-4d58-9e06-c91624e930f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:08:02 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-302ccba2-d195-4da8-9672-4187c9984aee tempest-VolumesGetTest-1330055057 None] Created volume successfully. Apr 15 20:08:02 devstack sudo[86180]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-fe40d20e-cc08-4920-94d9-673ff8c1186c req-e8bfcfdf-3a1e-4de3-b203-ff264344d3e0 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.458s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:02 devstack cinder-volume[82989]: DEBUG cinder.manager [req-fe40d20e-cc08-4920-94d9-673ff8c1186c req-e8bfcfdf-3a1e-4de3-b203-ff264344d3e0 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:08:02 devstack cinder-volume[82989]: INFO cinder.volume.manager [req-fe40d20e-cc08-4920-94d9-673ff8c1186c req-e8bfcfdf-3a1e-4de3-b203-ff264344d3e0 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Deleted volume successfully. Apr 15 20:08:02 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-fe40d20e-cc08-4920-94d9-673ff8c1186c req-e8bfcfdf-3a1e-4de3-b203-ff264344d3e0 tempest-ServerBootFromVolumeStableRescueTest-180298413 None] Lock "cinder-1158390f-3495-4599-8c27-213e61b83aa8-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:08:02 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-c6f53ace-e748-43b5-8837-43978b0e26aa tempest-GroupSnapshotsV319Test-1898056699 None] Group tempest-GroupSnapshotsV319Test-Group-701430060: creating Apr 15 20:08:02 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-c6f53ace-e748-43b5-8837-43978b0e26aa tempest-GroupSnapshotsV319Test-1898056699 None] Group tempest-GroupSnapshotsV319Test-Group-701430060: created successfully Apr 15 20:08:02 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-c6f53ace-e748-43b5-8837-43978b0e26aa tempest-GroupSnapshotsV319Test-1898056699 None] Create group completed successfully. Apr 15 20:08:03 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3e793280-693f-40ee-ad00-f402b9402c73 tempest-VolumesGetTest-1330055057 None] Acquiring lock "cinder-64ee316d-fe7c-4270-8c03-cb97adee4f40-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:08:03 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3e793280-693f-40ee-ad00-f402b9402c73 tempest-VolumesGetTest-1330055057 None] Lock "cinder-64ee316d-fe7c-4270-8c03-cb97adee4f40-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:08:03 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3e793280-693f-40ee-ad00-f402b9402c73 tempest-VolumesGetTest-1330055057 None] Acquiring lock "cinder-quobyte-64ee316d-fe7c-4270-8c03-cb97adee4f40" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:08:03 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3e793280-693f-40ee-ad00-f402b9402c73 tempest-VolumesGetTest-1330055057 None] Lock "cinder-quobyte-64ee316d-fe7c-4270-8c03-cb97adee4f40" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:08:03 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f1ff34-110f-4e4d-9f9a-16a2077337a5]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e793280-693f-40ee-ad00-f402b9402c73 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-64ee316d-fe7c-4270-8c03-cb97adee4f40 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:03 devstack sudo[86183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-64ee316d-fe7c-4270-8c03-cb97adee4f40 Apr 15 20:08:03 devstack sudo[86183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:03 devstack sudo[86183]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e793280-693f-40ee-ad00-f402b9402c73 tempest-VolumesGetTest-1330055057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-64ee316d-fe7c-4270-8c03-cb97adee4f40" returned: 0 in 0.506s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e793280-693f-40ee-ad00-f402b9402c73 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-64ee316d-fe7c-4270-8c03-cb97adee4f40 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:03 devstack sudo[86188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-64ee316d-fe7c-4270-8c03-cb97adee4f40 Apr 15 20:08:03 devstack sudo[86188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:04 devstack sudo[86188]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e793280-693f-40ee-ad00-f402b9402c73 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-64ee316d-fe7c-4270-8c03-cb97adee4f40" returned: 0 in 0.461s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3e793280-693f-40ee-ad00-f402b9402c73 tempest-VolumesGetTest-1330055057 None] Lock "cinder-quobyte-64ee316d-fe7c-4270-8c03-cb97adee4f40" released by "delete_volume" :: held 0.998s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-3e793280-693f-40ee-ad00-f402b9402c73 tempest-VolumesGetTest-1330055057 None] Created reservations ['8348f49a-b587-43df-bd1b-0b76f064b368', 'cc93676a-8d86-4cd0-992b-6ec6fb688839', 'e6c0aaf0-e966-4d99-80f5-6e04dd72695f', '1dade0e6-e168-4ee6-9a7c-0ccbda2bc6ec'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Flow 'volume_create_manager' (28d0e4d5-312e-4edd-a694-29c9a8a73a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5dd6a30-66a9-4c09-8a5f-b7d5c54dd2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5dd6a30-66a9-4c09-8a5f-b7d5c54dd2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1544858535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6381a49-7835-4e9f-abfe-1008ee7f1e2f,host='devstack@QuobyteHD#QuobyteHD',id=b3c14270-64b1-46f3-9c79-0b524e436f76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06885cdc6654689933ae1c32a3df089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:04Z,use_quota=True,user_id='ab702cd821344048bcc88c8484bea079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cde28fe-c94f-4316-8207-252a6490051a),volume_type_id=5cde28fe-c94f-4316-8207-252a6490051a)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde7073d-70ff-44b3-8178-4b1a7e4cee5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde7073d-70ff-44b3-8178-4b1a7e4cee5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e3ba72-8d07-45f9-b71f-5b9f0707896d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e3ba72-8d07-45f9-b71f-5b9f0707896d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3c14270-64b1-46f3-9c79-0b524e436f76', 'volume_name': 'volume-b3c14270-64b1-46f3-9c79-0b524e436f76', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a05260ea-91c7-41c5-9a27-ae55d124d4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a05260ea-91c7-41c5-9a27-ae55d124d4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502c8aaf-4dbe-40a0-b420-1f2e63844991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:04 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Volume b3c14270-64b1-46f3-9c79-0b524e436f76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3c14270-64b1-46f3-9c79-0b524e436f76', 'volume_size': 1} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c6381a49-7835-4e9f-abfe-1008ee7f1e2f,created_at=2026-04-15T18:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1544858535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6381a49-7835-4e9f-abfe-1008ee7f1e2f,host='devstack@QuobyteHD#QuobyteHD',id=b3c14270-64b1-46f3-9c79-0b524e436f76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06885cdc6654689933ae1c32a3df089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:04Z,use_quota=True,user_id='ab702cd821344048bcc88c8484bea079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cde28fe-c94f-4316-8207-252a6490051a),volume_type_id=5cde28fe-c94f-4316-8207-252a6490051a)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Creating volume b3c14270-64b1-46f3-9c79-0b524e436f76 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:08:04 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:04 devstack sudo[86192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76 1073741824 Apr 15 20:08:04 devstack sudo[86192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3e793280-693f-40ee-ad00-f402b9402c73 tempest-VolumesGetTest-1330055057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3e793280-693f-40ee-ad00-f402b9402c73 tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3e793280-693f-40ee-ad00-f402b9402c73 tempest-VolumesGetTest-1330055057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3e793280-693f-40ee-ad00-f402b9402c73 tempest-VolumesGetTest-1330055057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3e793280-693f-40ee-ad00-f402b9402c73 tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e793280-693f-40ee-ad00-f402b9402c73 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:04 devstack sudo[86194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:08:04 devstack sudo[86194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:04 devstack sudo[86194]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e793280-693f-40ee-ad00-f402b9402c73 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.449s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-3e793280-693f-40ee-ad00-f402b9402c73 tempest-VolumesGetTest-1330055057 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:08:04 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-3e793280-693f-40ee-ad00-f402b9402c73 tempest-VolumesGetTest-1330055057 None] Deleted volume successfully. Apr 15 20:08:04 devstack sudo[86192]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76 1073741824" returned: 0 in 0.508s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3e793280-693f-40ee-ad00-f402b9402c73 tempest-VolumesGetTest-1330055057 None] Lock "cinder-64ee316d-fe7c-4270-8c03-cb97adee4f40-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:08:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:04 devstack sudo[86200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76 Apr 15 20:08:04 devstack sudo[86200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e9d19706-437a-48dd-ba45-4b2ecaac3fc5 tempest-VolumesGetTest-1330055057 None] Acquiring lock "cinder-b3d978f6-f5dd-4146-ae97-bf49a1b11417-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:08:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e9d19706-437a-48dd-ba45-4b2ecaac3fc5 tempest-VolumesGetTest-1330055057 None] Lock "cinder-b3d978f6-f5dd-4146-ae97-bf49a1b11417-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:08:05 devstack sudo[86200]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e9d19706-437a-48dd-ba45-4b2ecaac3fc5 tempest-VolumesGetTest-1330055057 None] Acquiring lock "cinder-quobyte-b3d978f6-f5dd-4146-ae97-bf49a1b11417" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:08:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76" returned: 0 in 0.589s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:08:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e9d19706-437a-48dd-ba45-4b2ecaac3fc5 tempest-VolumesGetTest-1330055057 None] Lock "cinder-quobyte-b3d978f6-f5dd-4146-ae97-bf49a1b11417" acquired by "delete_volume" :: waited 0.017s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:08:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502c8aaf-4dbe-40a0-b420-1f2e63844991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3c14270-64b1-46f3-9c79-0b524e436f76', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9881b8b3-6d61-4f10-bd87-230b1a758a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:05 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf20c342-3069-4dbc-bc42-30b3998518dd]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e9d19706-437a-48dd-ba45-4b2ecaac3fc5 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3d978f6-f5dd-4146-ae97-bf49a1b11417 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:05 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Volume volume-b3c14270-64b1-46f3-9c79-0b524e436f76 (b3c14270-64b1-46f3-9c79-0b524e436f76): created successfully Apr 15 20:08:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9881b8b3-6d61-4f10-bd87-230b1a758a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Flow 'volume_create_manager' (28d0e4d5-312e-4edd-a694-29c9a8a73a99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:08:05 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-37da30f1-1c9c-4a48-9f87-5ae8759a5c03 tempest-GroupSnapshotsV319Test-1898056699 None] Created volume successfully. Apr 15 20:08:05 devstack sudo[86230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3d978f6-f5dd-4146-ae97-bf49a1b11417 Apr 15 20:08:05 devstack sudo[86230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:06 devstack sudo[86230]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e9d19706-437a-48dd-ba45-4b2ecaac3fc5 tempest-VolumesGetTest-1330055057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3d978f6-f5dd-4146-ae97-bf49a1b11417" returned: 0 in 0.539s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e9d19706-437a-48dd-ba45-4b2ecaac3fc5 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3d978f6-f5dd-4146-ae97-bf49a1b11417 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:06 devstack sudo[86238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3d978f6-f5dd-4146-ae97-bf49a1b11417 Apr 15 20:08:06 devstack sudo[86238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:06 devstack sudo[86238]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e9d19706-437a-48dd-ba45-4b2ecaac3fc5 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3d978f6-f5dd-4146-ae97-bf49a1b11417" returned: 0 in 0.440s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:06 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e9d19706-437a-48dd-ba45-4b2ecaac3fc5 tempest-VolumesGetTest-1330055057 None] Lock "cinder-quobyte-b3d978f6-f5dd-4146-ae97-bf49a1b11417" released by "delete_volume" :: held 1.015s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:08:06 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-e9d19706-437a-48dd-ba45-4b2ecaac3fc5 tempest-VolumesGetTest-1330055057 None] Created reservations ['03bb4662-862f-47c8-8a00-1790c55904b4', '0d8493e2-d197-493e-b6bf-92f28501e06c', 'd5741252-de4b-4fdd-aab3-bb1df2f0a615', 'a5406ce9-f86f-473f-9f36-7879ac2a9fa7'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:08:06 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-778888a4-acbd-40aa-931d-740f56b8be95 tempest-GroupSnapshotsV319Test-1898056699 None] GroupSnapshot e665dac8-a398-4483-b7cd-c7969266b202: creating. Apr 15 20:08:06 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-778888a4-acbd-40aa-931d-740f56b8be95 tempest-GroupSnapshotsV319Test-1898056699 None] Group snapshot e665dac8-a398-4483-b7cd-c7969266b202: creating. {{(pid=82989) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 20:08:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-778888a4-acbd-40aa-931d-740f56b8be95 tempest-GroupSnapshotsV319Test-1898056699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-778888a4-acbd-40aa-931d-740f56b8be95 tempest-GroupSnapshotsV319Test-1898056699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e9d19706-437a-48dd-ba45-4b2ecaac3fc5 tempest-VolumesGetTest-1330055057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e9d19706-437a-48dd-ba45-4b2ecaac3fc5 tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:06 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e9d19706-437a-48dd-ba45-4b2ecaac3fc5 tempest-VolumesGetTest-1330055057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:08:06 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e9d19706-437a-48dd-ba45-4b2ecaac3fc5 tempest-VolumesGetTest-1330055057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:08:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e9d19706-437a-48dd-ba45-4b2ecaac3fc5 tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e9d19706-437a-48dd-ba45-4b2ecaac3fc5 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:06 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-778888a4-acbd-40aa-931d-740f56b8be95 tempest-GroupSnapshotsV319Test-1898056699 None] Creating offline snapshot 345e02b0-77d6-4dac-9620-1c5b7354af1f of volume b3c14270-64b1-46f3-9c79-0b524e436f76 {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:08:06 devstack sudo[86244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:08:06 devstack sudo[86244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:06 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc884e4-c2b8-4fad-a5b9-3dc32224ea50]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-778888a4-acbd-40aa-931d-740f56b8be95 tempest-GroupSnapshotsV319Test-1898056699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:06 devstack sudo[86246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76 Apr 15 20:08:06 devstack sudo[86246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:07 devstack sudo[86244]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e9d19706-437a-48dd-ba45-4b2ecaac3fc5 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.400s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:07 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-e9d19706-437a-48dd-ba45-4b2ecaac3fc5 tempest-VolumesGetTest-1330055057 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:08:07 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-e9d19706-437a-48dd-ba45-4b2ecaac3fc5 tempest-VolumesGetTest-1330055057 None] Deleted volume successfully. Apr 15 20:08:07 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e9d19706-437a-48dd-ba45-4b2ecaac3fc5 tempest-VolumesGetTest-1330055057 None] Lock "cinder-b3d978f6-f5dd-4146-ae97-bf49a1b11417-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:08:07 devstack sudo[86246]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-778888a4-acbd-40aa-931d-740f56b8be95 tempest-GroupSnapshotsV319Test-1898056699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76" returned: 0 in 0.503s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-778888a4-acbd-40aa-931d-740f56b8be95 tempest-GroupSnapshotsV319Test-1898056699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.345e02b0-77d6-4dac-9620-1c5b7354af1f 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:07 devstack sudo[86253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.345e02b0-77d6-4dac-9620-1c5b7354af1f 1G Apr 15 20:08:07 devstack sudo[86253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:07 devstack sudo[86253]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-778888a4-acbd-40aa-931d-740f56b8be95 tempest-GroupSnapshotsV319Test-1898056699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.345e02b0-77d6-4dac-9620-1c5b7354af1f 1G" returned: 0 in 0.604s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-778888a4-acbd-40aa-931d-740f56b8be95 tempest-GroupSnapshotsV319Test-1898056699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3c14270-64b1-46f3-9c79-0b524e436f76 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.345e02b0-77d6-4dac-9620-1c5b7354af1f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:07 devstack sudo[86292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3c14270-64b1-46f3-9c79-0b524e436f76 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.345e02b0-77d6-4dac-9620-1c5b7354af1f Apr 15 20:08:07 devstack sudo[86292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:07 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:08:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Flow 'volume_create_manager' (716afcdc-2cd7-4c94-87a6-c37b793bbcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:08:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64f089d-0c9c-4812-ad46-f9647db710b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64f089d-0c9c-4812-ad46-f9647db710b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1526138827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53194dc7-8fe1-41a9-bd88-82e9aaae668d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e827dca35b45461d958ad9e8cf1ad1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:08Z,use_quota=True,user_id='b2cefbbe44fe47418192b0b2d636c965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a10a0d23-de0f-439f-8557-5859235c64cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a10a0d23-de0f-439f-8557-5859235c64cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf8f2f1-89db-4ba8-8e4d-92e352c02cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf8f2f1-89db-4ba8-8e4d-92e352c02cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53194dc7-8fe1-41a9-bd88-82e9aaae668d', 'volume_name': 'volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a55ffdc-ede3-4828-9974-0661f2eeb870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a55ffdc-ede3-4828-9974-0661f2eeb870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7d78f5-3f51-42a3-836c-c6174eb31637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:07 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Volume 53194dc7-8fe1-41a9-bd88-82e9aaae668d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d', 'volume_size': 1} Apr 15 20:08:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:08 devstack sudo[86292]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-778888a4-acbd-40aa-931d-740f56b8be95 tempest-GroupSnapshotsV319Test-1898056699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3c14270-64b1-46f3-9c79-0b524e436f76 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.345e02b0-77d6-4dac-9620-1c5b7354af1f" returned: 0 in 0.458s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:08 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-778888a4-acbd-40aa-931d-740f56b8be95 tempest-GroupSnapshotsV319Test-1898056699 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.345e02b0-77d6-4dac-9620-1c5b7354af1f is being set with open permissions: ugo+rw: NotImplementedError Apr 15 20:08:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-778888a4-acbd-40aa-931d-740f56b8be95 tempest-GroupSnapshotsV319Test-1898056699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.345e02b0-77d6-4dac-9620-1c5b7354af1f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:08 devstack sudo[86297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.345e02b0-77d6-4dac-9620-1c5b7354af1f Apr 15 20:08:08 devstack sudo[86297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:08 devstack sudo[86297]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-778888a4-acbd-40aa-931d-740f56b8be95 tempest-GroupSnapshotsV319Test-1898056699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.345e02b0-77d6-4dac-9620-1c5b7354af1f" returned: 0 in 0.394s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-778888a4-acbd-40aa-931d-740f56b8be95 tempest-GroupSnapshotsV319Test-1898056699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:08 devstack sudo[86300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.info Apr 15 20:08:08 devstack sudo[86300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:09 devstack sudo[86300]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-778888a4-acbd-40aa-931d-740f56b8be95 tempest-GroupSnapshotsV319Test-1898056699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.info" returned: 0 in 0.437s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:09 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-778888a4-acbd-40aa-931d-740f56b8be95 tempest-GroupSnapshotsV319Test-1898056699 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 20:08:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-778888a4-acbd-40aa-931d-740f56b8be95 tempest-GroupSnapshotsV319Test-1898056699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:09 devstack sudo[86303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.info Apr 15 20:08:09 devstack sudo[86303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:09 devstack sudo[86303]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-778888a4-acbd-40aa-931d-740f56b8be95 tempest-GroupSnapshotsV319Test-1898056699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.info" returned: 0 in 0.395s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-778888a4-acbd-40aa-931d-740f56b8be95 tempest-GroupSnapshotsV319Test-1898056699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.858s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.594s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1526138827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53194dc7-8fe1-41a9-bd88-82e9aaae668d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e827dca35b45461d958ad9e8cf1ad1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:08Z,use_quota=True,user_id='b2cefbbe44fe47418192b0b2d636c965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:08:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Creating volume 53194dc7-8fe1-41a9-bd88-82e9aaae668d {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:08:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:08:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:08:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:08:09 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:08:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:09 devstack sudo[86306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d 1073741824 Apr 15 20:08:09 devstack sudo[86306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:09 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-778888a4-acbd-40aa-931d-740f56b8be95 tempest-GroupSnapshotsV319Test-1898056699 None] group_snapshot e665dac8-a398-4483-b7cd-c7969266b202: created successfully Apr 15 20:08:10 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-611b903d-62a8-4700-b8ae-f3d313738472 tempest-GroupSnapshotsV319Test-1898056699 None] group_snapshot e665dac8-a398-4483-b7cd-c7969266b202: deleting Apr 15 20:08:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-611b903d-62a8-4700-b8ae-f3d313738472 tempest-GroupSnapshotsV319Test-1898056699 None] group_snapshot e665dac8-a398-4483-b7cd-c7969266b202: deleting {{(pid=82989) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 20:08:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-611b903d-62a8-4700-b8ae-f3d313738472 tempest-GroupSnapshotsV319Test-1898056699 None] Acquiring lock "cinder-quobyte-b3c14270-64b1-46f3-9c79-0b524e436f76" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:08:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-611b903d-62a8-4700-b8ae-f3d313738472 tempest-GroupSnapshotsV319Test-1898056699 None] Lock "cinder-quobyte-b3c14270-64b1-46f3-9c79-0b524e436f76" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:08:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-611b903d-62a8-4700-b8ae-f3d313738472 tempest-GroupSnapshotsV319Test-1898056699 None] Acquiring lock "cinder-quobyte-345e02b0-77d6-4dac-9620-1c5b7354af1f" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:08:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-611b903d-62a8-4700-b8ae-f3d313738472 tempest-GroupSnapshotsV319Test-1898056699 None] Lock "cinder-quobyte-345e02b0-77d6-4dac-9620-1c5b7354af1f" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:08:10 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-611b903d-62a8-4700-b8ae-f3d313738472 tempest-GroupSnapshotsV319Test-1898056699 None] Deleting offline snapshot 345e02b0-77d6-4dac-9620-1c5b7354af1f of volume b3c14270-64b1-46f3-9c79-0b524e436f76 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:08:10 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-611b903d-62a8-4700-b8ae-f3d313738472 tempest-GroupSnapshotsV319Test-1898056699 None] snapshot_file for this snap is: volume-b3c14270-64b1-46f3-9c79-0b524e436f76.345e02b0-77d6-4dac-9620-1c5b7354af1f {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:08:10 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c44a9e-380a-48d4-9be9-f8ef25d84f80]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-611b903d-62a8-4700-b8ae-f3d313738472 tempest-GroupSnapshotsV319Test-1898056699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.345e02b0-77d6-4dac-9620-1c5b7354af1f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:10 devstack sudo[86306]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d 1073741824" returned: 0 in 0.627s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:10 devstack sudo[86312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d Apr 15 20:08:10 devstack sudo[86312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:10 devstack sudo[86311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.345e02b0-77d6-4dac-9620-1c5b7354af1f Apr 15 20:08:10 devstack sudo[86311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:10 devstack sudo[86312]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d" returned: 0 in 0.479s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:10 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:08:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7d78f5-3f51-42a3-836c-c6174eb31637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfae7fbb-5de1-46f5-9b63-f99dfb8fb1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:10 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Volume volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d (53194dc7-8fe1-41a9-bd88-82e9aaae668d): created successfully Apr 15 20:08:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfae7fbb-5de1-46f5-9b63-f99dfb8fb1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Flow 'volume_create_manager' (716afcdc-2cd7-4c94-87a6-c37b793bbcb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:08:10 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-de25f81b-dd73-4298-a782-acb7b7c67388 tempest-VolumesGetTest-1330055057 None] Created volume successfully. Apr 15 20:08:10 devstack sudo[86311]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-611b903d-62a8-4700-b8ae-f3d313738472 tempest-GroupSnapshotsV319Test-1898056699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.345e02b0-77d6-4dac-9620-1c5b7354af1f" returned: 0 in 0.592s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:10 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-611b903d-62a8-4700-b8ae-f3d313738472 tempest-GroupSnapshotsV319Test-1898056699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3c14270-64b1-46f3-9c79-0b524e436f76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:08:10 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc23327-1fcd-4ff8-b8cb-8d060f2099c5]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-611b903d-62a8-4700-b8ae-f3d313738472 tempest-GroupSnapshotsV319Test-1898056699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:10 devstack sudo[86319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76 Apr 15 20:08:10 devstack sudo[86319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:11 devstack sudo[86319]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-611b903d-62a8-4700-b8ae-f3d313738472 tempest-GroupSnapshotsV319Test-1898056699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76" returned: 0 in 0.580s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-611b903d-62a8-4700-b8ae-f3d313738472 tempest-GroupSnapshotsV319Test-1898056699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.345e02b0-77d6-4dac-9620-1c5b7354af1f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:11 devstack sudo[86325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.345e02b0-77d6-4dac-9620-1c5b7354af1f Apr 15 20:08:11 devstack sudo[86325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:11 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:08:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Flow 'volume_create_manager' (54933a6b-8da3-4d73-98c4-99c1a5722a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:08:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea2fbcb-48f2-4f9a-85c3-2b5a1777f43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea2fbcb-48f2-4f9a-85c3-2b5a1777f43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-892006005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3adc506-3662-4206-a15d-6f40f315bb3c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e827dca35b45461d958ad9e8cf1ad1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=53194dc7-8fe1-41a9-bd88-82e9aaae668d,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:11Z,use_quota=True,user_id='b2cefbbe44fe47418192b0b2d636c965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a1664d-ee2d-479e-af08-6c1686477483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a1664d-ee2d-479e-af08-6c1686477483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ce10c3-3d03-44a8-b179-042955f1c4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ce10c3-3d03-44a8-b179-042955f1c4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f3adc506-3662-4206-a15d-6f40f315bb3c', 'volume_name': 'volume-f3adc506-3662-4206-a15d-6f40f315bb3c', 'volume_size': 1, 'source_volid': '53194dc7-8fe1-41a9-bd88-82e9aaae668d', 'source_volstatus': 'available'}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a625ad0-5b99-48de-b1c5-68f2467650ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a625ad0-5b99-48de-b1c5-68f2467650ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e42254d-b5fb-4c8a-8972-856a04a72767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:11 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Volume f3adc506-3662-4206-a15d-6f40f315bb3c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f3adc506-3662-4206-a15d-6f40f315bb3c', 'volume_size': 1, 'source_volid': '53194dc7-8fe1-41a9-bd88-82e9aaae668d', 'source_volstatus': 'available'} Apr 15 20:08:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:11 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Cloning volume 53194dc7-8fe1-41a9-bd88-82e9aaae668d to volume f3adc506-3662-4206-a15d-6f40f315bb3c Apr 15 20:08:11 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Creating offline snapshot 84c2e34c-7e10-4e96-b6e9-abd911b050a2 of volume 53194dc7-8fe1-41a9-bd88-82e9aaae668d {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:08:11 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e979a0a-1a88-4b52-8e16-e860b9ad8370]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:11 devstack sudo[86327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d Apr 15 20:08:11 devstack sudo[86327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:11 devstack sudo[86325]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-611b903d-62a8-4700-b8ae-f3d313738472 tempest-GroupSnapshotsV319Test-1898056699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.345e02b0-77d6-4dac-9620-1c5b7354af1f" returned: 0 in 0.564s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-611b903d-62a8-4700-b8ae-f3d313738472 tempest-GroupSnapshotsV319Test-1898056699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.345e02b0-77d6-4dac-9620-1c5b7354af1f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:11 devstack sudo[86332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.345e02b0-77d6-4dac-9620-1c5b7354af1f Apr 15 20:08:11 devstack sudo[86332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:12 devstack sudo[86327]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d" returned: 0 in 0.551s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.84c2e34c-7e10-4e96-b6e9-abd911b050a2 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:12 devstack sudo[86338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.84c2e34c-7e10-4e96-b6e9-abd911b050a2 1G Apr 15 20:08:12 devstack sudo[86338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:12 devstack sudo[86332]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-611b903d-62a8-4700-b8ae-f3d313738472 tempest-GroupSnapshotsV319Test-1898056699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76.345e02b0-77d6-4dac-9620-1c5b7354af1f" returned: 0 in 0.525s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:12 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-611b903d-62a8-4700-b8ae-f3d313738472 tempest-GroupSnapshotsV319Test-1898056699 None] Lock "cinder-quobyte-345e02b0-77d6-4dac-9620-1c5b7354af1f" released by "_delete_snapshot" :: held 2.320s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:08:12 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-611b903d-62a8-4700-b8ae-f3d313738472 tempest-GroupSnapshotsV319Test-1898056699 None] Lock "cinder-quobyte-b3c14270-64b1-46f3-9c79-0b524e436f76" released by "delete_snapshot" :: held 2.333s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:08:12 devstack cinder-volume[82989]: WARNING cinder.quota [None req-611b903d-62a8-4700-b8ae-f3d313738472 tempest-GroupSnapshotsV319Test-1898056699 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1621627179 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1621627179, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:08:12 devstack cinder-volume[82989]: WARNING cinder.quota [None req-611b903d-62a8-4700-b8ae-f3d313738472 tempest-GroupSnapshotsV319Test-1898056699 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1621627179 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1621627179, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:08:12 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-611b903d-62a8-4700-b8ae-f3d313738472 tempest-GroupSnapshotsV319Test-1898056699 None] Created reservations ['325ee714-3c33-47b3-9960-d65e21930caa', '569ec807-e1d5-459d-a924-a8572cd6195e', '58d89b89-685f-4ef4-8270-b227e4dc018b', '36dedff4-42f0-4957-9ec1-c514691d3ede'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:08:12 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-611b903d-62a8-4700-b8ae-f3d313738472 tempest-GroupSnapshotsV319Test-1898056699 None] group_snapshot e665dac8-a398-4483-b7cd-c7969266b202: deleted successfully Apr 15 20:08:12 devstack sudo[86338]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.84c2e34c-7e10-4e96-b6e9-abd911b050a2 1G" returned: 0 in 0.576s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.84c2e34c-7e10-4e96-b6e9-abd911b050a2 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:12 devstack sudo[86344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.84c2e34c-7e10-4e96-b6e9-abd911b050a2 Apr 15 20:08:12 devstack sudo[86344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:13 devstack sudo[86344]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.84c2e34c-7e10-4e96-b6e9-abd911b050a2" returned: 0 in 0.495s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:13 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.84c2e34c-7e10-4e96-b6e9-abd911b050a2 is being set with open permissions: ugo+rw Apr 15 20:08:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.84c2e34c-7e10-4e96-b6e9-abd911b050a2 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:13 devstack sudo[86350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.84c2e34c-7e10-4e96-b6e9-abd911b050a2 Apr 15 20:08:13 devstack sudo[86350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:13 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5a748757-734a-4925-b199-703bbe5e3479 tempest-GroupSnapshotsV319Test-1898056699 None] Acquiring lock "cinder-quobyte-b3c14270-64b1-46f3-9c79-0b524e436f76" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:08:13 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5a748757-734a-4925-b199-703bbe5e3479 tempest-GroupSnapshotsV319Test-1898056699 None] Lock "cinder-quobyte-b3c14270-64b1-46f3-9c79-0b524e436f76" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:08:13 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[557c5eaf-8855-4a86-b28a-8d55f419e1e3]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a748757-734a-4925-b199-703bbe5e3479 tempest-GroupSnapshotsV319Test-1898056699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:13 devstack sudo[86350]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.84c2e34c-7e10-4e96-b6e9-abd911b050a2" returned: 0 in 0.478s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:13 devstack sudo[86353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76 Apr 15 20:08:13 devstack sudo[86353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:13 devstack sudo[86355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.info Apr 15 20:08:13 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:14 devstack sudo[86353]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a748757-734a-4925-b199-703bbe5e3479 tempest-GroupSnapshotsV319Test-1898056699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76" returned: 0 in 0.539s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a748757-734a-4925-b199-703bbe5e3479 tempest-GroupSnapshotsV319Test-1898056699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:14 devstack sudo[86361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76 Apr 15 20:08:14 devstack sudo[86361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:14 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.info" returned: 0 in 0.484s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:14 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.info is being set with open permissions: ugo+rw Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:14 devstack sudo[86363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.info Apr 15 20:08:14 devstack sudo[86363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:14 devstack sudo[86363]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.info" returned: 0 in 0.497s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:14 devstack sudo[86361]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Acquiring lock "cinder-quobyte-f3adc506-3662-4206-a15d-6f40f315bb3c" by "_copy_volume_from_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a748757-734a-4925-b199-703bbe5e3479 tempest-GroupSnapshotsV319Test-1898056699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b3c14270-64b1-46f3-9c79-0b524e436f76" returned: 0 in 0.558s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5a748757-734a-4925-b199-703bbe5e3479 tempest-GroupSnapshotsV319Test-1898056699 None] Lock "cinder-quobyte-b3c14270-64b1-46f3-9c79-0b524e436f76" released by "delete_volume" :: held 1.125s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG dbcounter [-] [82989] Writing DB stats cinder:UPDATE=166,cinder:SELECT=117,cinder:INSERT=37,cinder:DELETE=9 {{(pid=82989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Lock "cinder-quobyte-f3adc506-3662-4206-a15d-6f40f315bb3c" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] snapshot: 84c2e34c-7e10-4e96-b6e9-abd911b050a2, volume: f3adc506-3662-4206-a15d-6f40f315bb3c, {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[6568db18-6f9f-4698-b456-f6daab417655]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.84c2e34c-7e10-4e96-b6e9-abd911b050a2 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-5a748757-734a-4925-b199-703bbe5e3479 tempest-GroupSnapshotsV319Test-1898056699 None] Created reservations ['34d6cf38-5f41-46ab-964c-d9dce1950c44'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:08:14 devstack cinder-volume[82989]: WARNING cinder.quota [None req-5a748757-734a-4925-b199-703bbe5e3479 tempest-GroupSnapshotsV319Test-1898056699 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1621627179 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1621627179, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-5a748757-734a-4925-b199-703bbe5e3479 tempest-GroupSnapshotsV319Test-1898056699 None] Created reservations ['8f69f3eb-a5f9-46bb-a42e-19f83c3f8624', 'b77c8a18-7d5a-4a78-b557-4619f36b81c9', '7241ccc4-0891-4e6d-bdab-fa90caecd463', 'd71c7c6b-18f0-49a7-8e95-220a0e3ff4ad'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:08:14 devstack sudo[86367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.84c2e34c-7e10-4e96-b6e9-abd911b050a2 Apr 15 20:08:14 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5a748757-734a-4925-b199-703bbe5e3479 tempest-GroupSnapshotsV319Test-1898056699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5a748757-734a-4925-b199-703bbe5e3479 tempest-GroupSnapshotsV319Test-1898056699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-5a748757-734a-4925-b199-703bbe5e3479 tempest-GroupSnapshotsV319Test-1898056699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-5a748757-734a-4925-b199-703bbe5e3479 tempest-GroupSnapshotsV319Test-1898056699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5a748757-734a-4925-b199-703bbe5e3479 tempest-GroupSnapshotsV319Test-1898056699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a748757-734a-4925-b199-703bbe5e3479 tempest-GroupSnapshotsV319Test-1898056699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:14 devstack sudo[86369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:08:14 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:15 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.84c2e34c-7e10-4e96-b6e9-abd911b050a2" returned: 0 in 0.519s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:08:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 20:08:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Creating direct copy from snapshot {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 20:08:15 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[749a913d-14e3-4895-959e-be20e5e7f27b]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:15 devstack sudo[86376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d Apr 15 20:08:15 devstack sudo[86376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:15 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a748757-734a-4925-b199-703bbe5e3479 tempest-GroupSnapshotsV319Test-1898056699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.492s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:15 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-5a748757-734a-4925-b199-703bbe5e3479 tempest-GroupSnapshotsV319Test-1898056699 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:08:15 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-5a748757-734a-4925-b199-703bbe5e3479 tempest-GroupSnapshotsV319Test-1898056699 None] Delete group completed successfully. Apr 15 20:08:15 devstack sudo[86376]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d" returned: 0 in 0.566s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:15 devstack cinder-volume[82989]: DEBUG cinder.utils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Path /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3adc506-3662-4206-a15d-6f40f315bb3c not found in is_blk_device check {{(pid=82989) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 20:08:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3adc506-3662-4206-a15d-6f40f315bb3c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:15 devstack sudo[86382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3adc506-3662-4206-a15d-6f40f315bb3c Apr 15 20:08:15 devstack sudo[86382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:18 devstack sudo[86382]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3adc506-3662-4206-a15d-6f40f315bb3c" returned: 0 in 2.258s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:18 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0a6ff5-c303-4994-ac1e-49931b1175e8]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:18 devstack sudo[86394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d Apr 15 20:08:18 devstack sudo[86394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:18 devstack sudo[86394]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d" returned: 0 in 0.731s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:18 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d, size 1024.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3adc506-3662-4206-a15d-6f40f315bb3c {{(pid=82989) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 20:08:18 devstack cinder-volume[82989]: INFO cinder.image.image_utils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Converted 1024.00 MB image at 453.20 MB/s Apr 15 20:08:18 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3adc506-3662-4206-a15d-6f40f315bb3c is being set with open permissions: ugo+rw Apr 15 20:08:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3adc506-3662-4206-a15d-6f40f315bb3c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:18 devstack sudo[86399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3adc506-3662-4206-a15d-6f40f315bb3c Apr 15 20:08:18 devstack sudo[86399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:19 devstack sudo[86399]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3adc506-3662-4206-a15d-6f40f315bb3c" returned: 0 in 0.582s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:19 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Lock "cinder-quobyte-f3adc506-3662-4206-a15d-6f40f315bb3c" released by "_copy_volume_from_snapshot" :: held 4.704s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:08:19 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Acquiring lock "cinder-quobyte-84c2e34c-7e10-4e96-b6e9-abd911b050a2" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:08:19 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Lock "cinder-quobyte-84c2e34c-7e10-4e96-b6e9-abd911b050a2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:08:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Deleting offline snapshot 84c2e34c-7e10-4e96-b6e9-abd911b050a2 of volume 53194dc7-8fe1-41a9-bd88-82e9aaae668d {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:08:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] snapshot_file for this snap is: volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.84c2e34c-7e10-4e96-b6e9-abd911b050a2 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:08:19 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff273c5f-d6ee-4395-84c2-2c3ac04a2a0a]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.84c2e34c-7e10-4e96-b6e9-abd911b050a2 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:19 devstack sudo[86402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.84c2e34c-7e10-4e96-b6e9-abd911b050a2 Apr 15 20:08:19 devstack sudo[86402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:20 devstack sudo[86402]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.84c2e34c-7e10-4e96-b6e9-abd911b050a2" returned: 0 in 0.607s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:20 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:08:20 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b655066-7c34-415a-b56c-797e1533947f]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:20 devstack sudo[86407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d Apr 15 20:08:20 devstack sudo[86407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:20 devstack sudo[86407]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d" returned: 0 in 0.756s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.84c2e34c-7e10-4e96-b6e9-abd911b050a2 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:20 devstack sudo[86412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.84c2e34c-7e10-4e96-b6e9-abd911b050a2 Apr 15 20:08:20 devstack sudo[86412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:21 devstack sudo[86412]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.84c2e34c-7e10-4e96-b6e9-abd911b050a2" returned: 0 in 0.652s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.84c2e34c-7e10-4e96-b6e9-abd911b050a2 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:21 devstack sudo[86417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.84c2e34c-7e10-4e96-b6e9-abd911b050a2 Apr 15 20:08:21 devstack sudo[86417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:22 devstack sudo[86417]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d.84c2e34c-7e10-4e96-b6e9-abd911b050a2" returned: 0 in 0.573s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Lock "cinder-quobyte-84c2e34c-7e10-4e96-b6e9-abd911b050a2" released by "_delete_snapshot" :: held 2.648s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:08:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.596s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e42254d-b5fb-4c8a-8972-856a04a72767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3adc506-3662-4206-a15d-6f40f315bb3c', 'volume_size': 1, 'source_volid': '53194dc7-8fe1-41a9-bd88-82e9aaae668d', 'source_volstatus': 'available'}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a559d135-6b76-4fd6-8e5c-403ed442c418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:22 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Volume volume-f3adc506-3662-4206-a15d-6f40f315bb3c (f3adc506-3662-4206-a15d-6f40f315bb3c): created successfully Apr 15 20:08:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a559d135-6b76-4fd6-8e5c-403ed442c418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Flow 'volume_create_manager' (54933a6b-8da3-4d73-98c4-99c1a5722a7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:08:22 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-d89c56e1-6a5a-42bf-9439-9fe9c6c1d938 tempest-VolumesGetTest-1330055057 None] Created volume successfully. Apr 15 20:08:23 devstack cinder-volume[82989]: DEBUG dbcounter [-] [82989] Writing DB stats cinder:DELETE=14,cinder:SELECT=102,cinder:UPDATE=120,cinder:INSERT=33 {{(pid=82989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:08:23 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:08:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Flow 'volume_create_manager' (7b88bcec-6b27-42fc-8631-4d7edabef370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:08:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e89d82-aeed-4a5f-b30d-474acea17ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e89d82-aeed-4a5f-b30d-474acea17ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:08:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-567266616',display_name='tempest-VolumesGetTest-Volume-1532130628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9df2065-0b33-4a3f-8598-0f4f769106ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e827dca35b45461d958ad9e8cf1ad1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:24Z,use_quota=True,user_id='b2cefbbe44fe47418192b0b2d636c965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8022807-38c6-4f33-94a7-53048655ed4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8022807-38c6-4f33-94a7-53048655ed4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af6f5724-a6cb-4a8b-a06c-5dc09b348aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af6f5724-a6cb-4a8b-a06c-5dc09b348aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9df2065-0b33-4a3f-8598-0f4f769106ab', 'volume_name': 'volume-a9df2065-0b33-4a3f-8598-0f4f769106ab', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f9a213-ae77-4ccf-a0c3-eefd8a07fca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f9a213-ae77-4ccf-a0c3-eefd8a07fca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e584ad1-c97c-4d16-8d0e-15d107e10558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:23 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Volume a9df2065-0b33-4a3f-8598-0f4f769106ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9df2065-0b33-4a3f-8598-0f4f769106ab', 'volume_size': 1} Apr 15 20:08:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:08:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-567266616',display_name='tempest-VolumesGetTest-Volume-1532130628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9df2065-0b33-4a3f-8598-0f4f769106ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e827dca35b45461d958ad9e8cf1ad1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:24Z,use_quota=True,user_id='b2cefbbe44fe47418192b0b2d636c965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:08:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Creating volume a9df2065-0b33-4a3f-8598-0f4f769106ab {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:08:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:08:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:08:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:08:23 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:08:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a9df2065-0b33-4a3f-8598-0f4f769106ab 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:23 devstack sudo[86421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a9df2065-0b33-4a3f-8598-0f4f769106ab 1073741824 Apr 15 20:08:23 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:24 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a9df2065-0b33-4a3f-8598-0f4f769106ab 1073741824" returned: 0 in 0.552s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a9df2065-0b33-4a3f-8598-0f4f769106ab {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:24 devstack sudo[86426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a9df2065-0b33-4a3f-8598-0f4f769106ab Apr 15 20:08:24 devstack sudo[86426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:24 devstack sudo[86426]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a9df2065-0b33-4a3f-8598-0f4f769106ab" returned: 0 in 0.501s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:24 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:08:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:24 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e584ad1-c97c-4d16-8d0e-15d107e10558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9df2065-0b33-4a3f-8598-0f4f769106ab', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:24 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b19fdd-1453-4419-a72e-d2099ee343ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:24 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Volume volume-a9df2065-0b33-4a3f-8598-0f4f769106ab (a9df2065-0b33-4a3f-8598-0f4f769106ab): created successfully Apr 15 20:08:24 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b19fdd-1453-4419-a72e-d2099ee343ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:24 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Flow 'volume_create_manager' (7b88bcec-6b27-42fc-8631-4d7edabef370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:08:24 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-69086aa2-da90-488f-9407-ef94dc99bb3c tempest-VolumesGetTest-1330055057 None] Created volume successfully. Apr 15 20:08:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7fdc226e-4cb2-4aca-b4f1-818c42022274 tempest-VolumesGetTest-1330055057 None] Acquiring lock "cinder-a9df2065-0b33-4a3f-8598-0f4f769106ab-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:08:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7fdc226e-4cb2-4aca-b4f1-818c42022274 tempest-VolumesGetTest-1330055057 None] Lock "cinder-a9df2065-0b33-4a3f-8598-0f4f769106ab-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:08:26 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7fdc226e-4cb2-4aca-b4f1-818c42022274 tempest-VolumesGetTest-1330055057 None] Acquiring lock "cinder-quobyte-a9df2065-0b33-4a3f-8598-0f4f769106ab" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:08:26 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7fdc226e-4cb2-4aca-b4f1-818c42022274 tempest-VolumesGetTest-1330055057 None] Lock "cinder-quobyte-a9df2065-0b33-4a3f-8598-0f4f769106ab" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:08:26 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf334b11-7b3b-4ec1-9a64-7c7d807ce394]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7fdc226e-4cb2-4aca-b4f1-818c42022274 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a9df2065-0b33-4a3f-8598-0f4f769106ab {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:26 devstack sudo[86439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a9df2065-0b33-4a3f-8598-0f4f769106ab Apr 15 20:08:26 devstack sudo[86439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:26 devstack sudo[86439]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7fdc226e-4cb2-4aca-b4f1-818c42022274 tempest-VolumesGetTest-1330055057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a9df2065-0b33-4a3f-8598-0f4f769106ab" returned: 0 in 0.654s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7fdc226e-4cb2-4aca-b4f1-818c42022274 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a9df2065-0b33-4a3f-8598-0f4f769106ab {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:26 devstack sudo[86444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a9df2065-0b33-4a3f-8598-0f4f769106ab Apr 15 20:08:26 devstack sudo[86444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:27 devstack sudo[86444]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7fdc226e-4cb2-4aca-b4f1-818c42022274 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a9df2065-0b33-4a3f-8598-0f4f769106ab" returned: 0 in 0.447s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7fdc226e-4cb2-4aca-b4f1-818c42022274 tempest-VolumesGetTest-1330055057 None] Lock "cinder-quobyte-a9df2065-0b33-4a3f-8598-0f4f769106ab" released by "delete_volume" :: held 1.126s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:08:27 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-7fdc226e-4cb2-4aca-b4f1-818c42022274 tempest-VolumesGetTest-1330055057 None] Created reservations ['979727a8-d74c-48f3-927c-85a4f6f5825e', '7a369c80-0f59-4597-8a90-ee810bd7f246', 'c96ef960-d2da-476e-8299-d21915d47388', 'b164d235-c2c1-4817-bb0e-43ea76f34eb7'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:08:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7fdc226e-4cb2-4aca-b4f1-818c42022274 tempest-VolumesGetTest-1330055057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7fdc226e-4cb2-4aca-b4f1-818c42022274 tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7fdc226e-4cb2-4aca-b4f1-818c42022274 tempest-VolumesGetTest-1330055057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:08:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7fdc226e-4cb2-4aca-b4f1-818c42022274 tempest-VolumesGetTest-1330055057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:08:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7fdc226e-4cb2-4aca-b4f1-818c42022274 tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7fdc226e-4cb2-4aca-b4f1-818c42022274 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:27 devstack sudo[86447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:08:27 devstack sudo[86447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:27 devstack cinder-volume[82989]: DEBUG oslo_service.periodic_task [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82989) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 20:08:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:08:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:08:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:27 devstack sudo[86449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:08:27 devstack sudo[86449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:27 devstack sudo[86447]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7fdc226e-4cb2-4aca-b4f1-818c42022274 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.538s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:27 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-7fdc226e-4cb2-4aca-b4f1-818c42022274 tempest-VolumesGetTest-1330055057 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:08:27 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-7fdc226e-4cb2-4aca-b4f1-818c42022274 tempest-VolumesGetTest-1330055057 None] Deleted volume successfully. Apr 15 20:08:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7fdc226e-4cb2-4aca-b4f1-818c42022274 tempest-VolumesGetTest-1330055057 None] Lock "cinder-a9df2065-0b33-4a3f-8598-0f4f769106ab-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:08:28 devstack sudo[86449]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.497s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-723732e6-9fcc-409b-8b41-d0ad0641ae82 tempest-VolumesGetTest-1330055057 None] Acquiring lock "cinder-f3adc506-3662-4206-a15d-6f40f315bb3c-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-723732e6-9fcc-409b-8b41-d0ad0641ae82 tempest-VolumesGetTest-1330055057 None] Lock "cinder-f3adc506-3662-4206-a15d-6f40f315bb3c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-723732e6-9fcc-409b-8b41-d0ad0641ae82 tempest-VolumesGetTest-1330055057 None] Acquiring lock "cinder-quobyte-f3adc506-3662-4206-a15d-6f40f315bb3c" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-723732e6-9fcc-409b-8b41-d0ad0641ae82 tempest-VolumesGetTest-1330055057 None] Lock "cinder-quobyte-f3adc506-3662-4206-a15d-6f40f315bb3c" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[7308d2a9-eda2-47b8-8bde-eb65434a94be]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-723732e6-9fcc-409b-8b41-d0ad0641ae82 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3adc506-3662-4206-a15d-6f40f315bb3c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:28 devstack sudo[86453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3adc506-3662-4206-a15d-6f40f315bb3c Apr 15 20:08:28 devstack sudo[86453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Flow 'volume_create_manager' (442fe005-79d5-43ab-b326-cebd2d214ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac065e58-d245-4d3d-8182-0ddd01e56167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac065e58-d245-4d3d-8182-0ddd01e56167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-709803340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee9025ea-262e-40e9-ad92-89617120fdc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96aea69aa26c40979e59d4f900ba58b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:29Z,use_quota=True,user_id='d034b2cb24ce45bc9f0d1d58d23150fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8914a448-1cb6-4ca2-bcdb-928b13e620d9),volume_type_id=8914a448-1cb6-4ca2-bcdb-928b13e620d9)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a486082-44c0-4db8-8b11-fb0dfc7fced1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a486082-44c0-4db8-8b11-fb0dfc7fced1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290f207f-eb67-455a-ae0a-d6c539a26b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290f207f-eb67-455a-ae0a-d6c539a26b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee9025ea-262e-40e9-ad92-89617120fdc7', 'volume_name': 'volume-ee9025ea-262e-40e9-ad92-89617120fdc7', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97013422-09c1-4821-9418-8a3af2520534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97013422-09c1-4821-9418-8a3af2520534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a754adc3-fdc8-4ded-95c1-95b7fd36bc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:28 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Volume ee9025ea-262e-40e9-ad92-89617120fdc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee9025ea-262e-40e9-ad92-89617120fdc7', 'volume_size': 1} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-709803340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee9025ea-262e-40e9-ad92-89617120fdc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96aea69aa26c40979e59d4f900ba58b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:29Z,use_quota=True,user_id='d034b2cb24ce45bc9f0d1d58d23150fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8914a448-1cb6-4ca2-bcdb-928b13e620d9),volume_type_id=8914a448-1cb6-4ca2-bcdb-928b13e620d9)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Creating volume ee9025ea-262e-40e9-ad92-89617120fdc7 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:08:28 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee9025ea-262e-40e9-ad92-89617120fdc7 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:28 devstack sudo[86458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee9025ea-262e-40e9-ad92-89617120fdc7 1073741824 Apr 15 20:08:28 devstack sudo[86458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:28 devstack sudo[86453]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-723732e6-9fcc-409b-8b41-d0ad0641ae82 tempest-VolumesGetTest-1330055057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3adc506-3662-4206-a15d-6f40f315bb3c" returned: 0 in 0.593s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-723732e6-9fcc-409b-8b41-d0ad0641ae82 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3adc506-3662-4206-a15d-6f40f315bb3c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:28 devstack sudo[86460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3adc506-3662-4206-a15d-6f40f315bb3c Apr 15 20:08:28 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:29 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-723732e6-9fcc-409b-8b41-d0ad0641ae82 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3adc506-3662-4206-a15d-6f40f315bb3c" returned: 0 in 0.446s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:29 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-723732e6-9fcc-409b-8b41-d0ad0641ae82 tempest-VolumesGetTest-1330055057 None] Lock "cinder-quobyte-f3adc506-3662-4206-a15d-6f40f315bb3c" released by "delete_volume" :: held 1.069s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:08:29 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-723732e6-9fcc-409b-8b41-d0ad0641ae82 tempest-VolumesGetTest-1330055057 None] Created reservations ['2641a76d-e126-440c-8fd1-3a53535fd5f1', '0e585dc4-d3a6-4963-b022-2b78a956ab16', '50ab346c-cdc4-4838-bae1-dd3d0a949563', '166fe877-d897-4513-8eb5-0d220647daec'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:08:29 devstack sudo[86458]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee9025ea-262e-40e9-ad92-89617120fdc7 1073741824" returned: 0 in 0.538s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee9025ea-262e-40e9-ad92-89617120fdc7 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:29 devstack sudo[86466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee9025ea-262e-40e9-ad92-89617120fdc7 Apr 15 20:08:29 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-723732e6-9fcc-409b-8b41-d0ad0641ae82 tempest-VolumesGetTest-1330055057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-723732e6-9fcc-409b-8b41-d0ad0641ae82 tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-723732e6-9fcc-409b-8b41-d0ad0641ae82 tempest-VolumesGetTest-1330055057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:08:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-723732e6-9fcc-409b-8b41-d0ad0641ae82 tempest-VolumesGetTest-1330055057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:08:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-723732e6-9fcc-409b-8b41-d0ad0641ae82 tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-723732e6-9fcc-409b-8b41-d0ad0641ae82 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:29 devstack sudo[86468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:08:29 devstack sudo[86468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:29 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee9025ea-262e-40e9-ad92-89617120fdc7" returned: 0 in 0.523s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:08:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a754adc3-fdc8-4ded-95c1-95b7fd36bc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee9025ea-262e-40e9-ad92-89617120fdc7', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (033c0e8c-ef8f-41ba-b375-e30cf0acb418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:29 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Volume volume-ee9025ea-262e-40e9-ad92-89617120fdc7 (ee9025ea-262e-40e9-ad92-89617120fdc7): created successfully Apr 15 20:08:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (033c0e8c-ef8f-41ba-b375-e30cf0acb418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Flow 'volume_create_manager' (442fe005-79d5-43ab-b326-cebd2d214ff1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:08:29 devstack sudo[86468]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-723732e6-9fcc-409b-8b41-d0ad0641ae82 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.528s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:29 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-723732e6-9fcc-409b-8b41-d0ad0641ae82 tempest-VolumesGetTest-1330055057 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:08:29 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-de0c8eab-ee2f-4d40-be95-7d12f716b540 tempest-VolumeTypesAccessTest-949023792 None] Created volume successfully. Apr 15 20:08:29 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-723732e6-9fcc-409b-8b41-d0ad0641ae82 tempest-VolumesGetTest-1330055057 None] Deleted volume successfully. Apr 15 20:08:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-723732e6-9fcc-409b-8b41-d0ad0641ae82 tempest-VolumesGetTest-1330055057 None] Lock "cinder-f3adc506-3662-4206-a15d-6f40f315bb3c-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:08:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e9a6dcb-6d33-480f-8b4f-d3d25b805f13 tempest-VolumesGetTest-1330055057 None] Acquiring lock "cinder-53194dc7-8fe1-41a9-bd88-82e9aaae668d-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:08:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e9a6dcb-6d33-480f-8b4f-d3d25b805f13 tempest-VolumesGetTest-1330055057 None] Lock "cinder-53194dc7-8fe1-41a9-bd88-82e9aaae668d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:08:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e9a6dcb-6d33-480f-8b4f-d3d25b805f13 tempest-VolumesGetTest-1330055057 None] Acquiring lock "cinder-quobyte-53194dc7-8fe1-41a9-bd88-82e9aaae668d" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:08:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e9a6dcb-6d33-480f-8b4f-d3d25b805f13 tempest-VolumesGetTest-1330055057 None] Lock "cinder-quobyte-53194dc7-8fe1-41a9-bd88-82e9aaae668d" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:08:30 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[815a6c11-1849-45f8-8a2c-7d4479ad08f0]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e9a6dcb-6d33-480f-8b4f-d3d25b805f13 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:30 devstack sudo[86474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d Apr 15 20:08:30 devstack sudo[86474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6b4007c8-c518-4279-8d2f-9b719fdfdbb4 tempest-VolumeTypesAccessTest-949023792 None] Acquiring lock "cinder-ee9025ea-262e-40e9-ad92-89617120fdc7-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:08:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6b4007c8-c518-4279-8d2f-9b719fdfdbb4 tempest-VolumeTypesAccessTest-949023792 None] Lock "cinder-ee9025ea-262e-40e9-ad92-89617120fdc7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:08:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6b4007c8-c518-4279-8d2f-9b719fdfdbb4 tempest-VolumeTypesAccessTest-949023792 None] Acquiring lock "cinder-quobyte-ee9025ea-262e-40e9-ad92-89617120fdc7" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:08:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6b4007c8-c518-4279-8d2f-9b719fdfdbb4 tempest-VolumeTypesAccessTest-949023792 None] Lock "cinder-quobyte-ee9025ea-262e-40e9-ad92-89617120fdc7" acquired by "delete_volume" :: waited 0.024s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:08:31 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9551ef4-fba3-4f1a-8dbe-161c3f0f0e3c]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6b4007c8-c518-4279-8d2f-9b719fdfdbb4 tempest-VolumeTypesAccessTest-949023792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee9025ea-262e-40e9-ad92-89617120fdc7 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:31 devstack sudo[86474]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e9a6dcb-6d33-480f-8b4f-d3d25b805f13 tempest-VolumesGetTest-1330055057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d" returned: 0 in 0.504s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e9a6dcb-6d33-480f-8b4f-d3d25b805f13 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:31 devstack sudo[86480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d Apr 15 20:08:31 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:31 devstack sudo[86479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee9025ea-262e-40e9-ad92-89617120fdc7 Apr 15 20:08:31 devstack sudo[86479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:31 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e9a6dcb-6d33-480f-8b4f-d3d25b805f13 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53194dc7-8fe1-41a9-bd88-82e9aaae668d" returned: 0 in 0.450s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:31 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e9a6dcb-6d33-480f-8b4f-d3d25b805f13 tempest-VolumesGetTest-1330055057 None] Lock "cinder-quobyte-53194dc7-8fe1-41a9-bd88-82e9aaae668d" released by "delete_volume" :: held 0.982s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:08:31 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-8e9a6dcb-6d33-480f-8b4f-d3d25b805f13 tempest-VolumesGetTest-1330055057 None] Created reservations ['4c7dd2d6-6fd7-46d1-b74a-7d509ccad506', '6295aaa3-e11f-4a43-8c4f-e538ff443fc7', '10478d9a-2e02-4ffa-ab0d-8d4b54887636', '3cb83531-c93e-48ad-a075-f52793ed03ed'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:08:31 devstack sudo[86479]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6b4007c8-c518-4279-8d2f-9b719fdfdbb4 tempest-VolumeTypesAccessTest-949023792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee9025ea-262e-40e9-ad92-89617120fdc7" returned: 0 in 0.578s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6b4007c8-c518-4279-8d2f-9b719fdfdbb4 tempest-VolumeTypesAccessTest-949023792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee9025ea-262e-40e9-ad92-89617120fdc7 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:31 devstack sudo[86502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee9025ea-262e-40e9-ad92-89617120fdc7 Apr 15 20:08:31 devstack sudo[86502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8e9a6dcb-6d33-480f-8b4f-d3d25b805f13 tempest-VolumesGetTest-1330055057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8e9a6dcb-6d33-480f-8b4f-d3d25b805f13 tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:31 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-8e9a6dcb-6d33-480f-8b4f-d3d25b805f13 tempest-VolumesGetTest-1330055057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:08:31 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-8e9a6dcb-6d33-480f-8b4f-d3d25b805f13 tempest-VolumesGetTest-1330055057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:08:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8e9a6dcb-6d33-480f-8b4f-d3d25b805f13 tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e9a6dcb-6d33-480f-8b4f-d3d25b805f13 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:31 devstack sudo[86504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:08:31 devstack sudo[86504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:32 devstack sudo[86502]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6b4007c8-c518-4279-8d2f-9b719fdfdbb4 tempest-VolumeTypesAccessTest-949023792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee9025ea-262e-40e9-ad92-89617120fdc7" returned: 0 in 0.454s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6b4007c8-c518-4279-8d2f-9b719fdfdbb4 tempest-VolumeTypesAccessTest-949023792 None] Lock "cinder-quobyte-ee9025ea-262e-40e9-ad92-89617120fdc7" released by "delete_volume" :: held 1.071s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:08:32 devstack cinder-volume[82989]: WARNING cinder.quota [None req-6b4007c8-c518-4279-8d2f-9b719fdfdbb4 tempest-VolumeTypesAccessTest-949023792 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1451059773 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1451059773, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:08:32 devstack cinder-volume[82989]: WARNING cinder.quota [None req-6b4007c8-c518-4279-8d2f-9b719fdfdbb4 tempest-VolumeTypesAccessTest-949023792 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1451059773 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1451059773, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:08:32 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-6b4007c8-c518-4279-8d2f-9b719fdfdbb4 tempest-VolumeTypesAccessTest-949023792 None] Created reservations ['6c802076-7186-46e8-9b6e-2739825da69a', 'd93e490e-ec2f-4867-abe4-42d8fe35fbab', '2187968d-2684-4ccf-80d6-475fcda0abc5', '9ba667eb-b436-486b-a601-01480aa4cef5'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:08:32 devstack sudo[86504]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e9a6dcb-6d33-480f-8b4f-d3d25b805f13 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.508s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:32 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-8e9a6dcb-6d33-480f-8b4f-d3d25b805f13 tempest-VolumesGetTest-1330055057 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:08:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-6b4007c8-c518-4279-8d2f-9b719fdfdbb4 tempest-VolumeTypesAccessTest-949023792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-6b4007c8-c518-4279-8d2f-9b719fdfdbb4 tempest-VolumeTypesAccessTest-949023792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:32 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-6b4007c8-c518-4279-8d2f-9b719fdfdbb4 tempest-VolumeTypesAccessTest-949023792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:08:32 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-6b4007c8-c518-4279-8d2f-9b719fdfdbb4 tempest-VolumeTypesAccessTest-949023792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:08:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-6b4007c8-c518-4279-8d2f-9b719fdfdbb4 tempest-VolumeTypesAccessTest-949023792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6b4007c8-c518-4279-8d2f-9b719fdfdbb4 tempest-VolumeTypesAccessTest-949023792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:32 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-8e9a6dcb-6d33-480f-8b4f-d3d25b805f13 tempest-VolumesGetTest-1330055057 None] Deleted volume successfully. Apr 15 20:08:32 devstack sudo[86509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:08:32 devstack sudo[86509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e9a6dcb-6d33-480f-8b4f-d3d25b805f13 tempest-VolumesGetTest-1330055057 None] Lock "cinder-53194dc7-8fe1-41a9-bd88-82e9aaae668d-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:08:32 devstack sudo[86509]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6b4007c8-c518-4279-8d2f-9b719fdfdbb4 tempest-VolumeTypesAccessTest-949023792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.419s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:32 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-6b4007c8-c518-4279-8d2f-9b719fdfdbb4 tempest-VolumeTypesAccessTest-949023792 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:08:32 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-6b4007c8-c518-4279-8d2f-9b719fdfdbb4 tempest-VolumeTypesAccessTest-949023792 None] Deleted volume successfully. Apr 15 20:08:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6b4007c8-c518-4279-8d2f-9b719fdfdbb4 tempest-VolumeTypesAccessTest-949023792 None] Lock "cinder-ee9025ea-262e-40e9-ad92-89617120fdc7-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:08:33 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:08:33 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Flow 'volume_create_manager' (edd56eb9-3754-4864-a154-c8abf5c7f027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:08:33 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d923d99-9789-4328-9fa7-8b2cfe7aada1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:33 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d923d99-9789-4328-9fa7-8b2cfe7aada1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1889749673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d23d8567-225b-4642-8412-1c1368895093,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e827dca35b45461d958ad9e8cf1ad1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:33Z,use_quota=True,user_id='b2cefbbe44fe47418192b0b2d636c965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:33 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b89c883e-93bf-481d-83c9-84c5c7e1ec7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:33 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b89c883e-93bf-481d-83c9-84c5c7e1ec7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:33 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74bc29f6-2326-425e-98d7-3f28d15b6897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:33 devstack cinder-volume[82989]: DEBUG cinder.image.glance [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Creating Keystone auth plugin from conf {{(pid=82989) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 20:08:33 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74bc29f6-2326-425e-98d7-3f28d15b6897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd23d8567-225b-4642-8412-1c1368895093', 'volume_name': 'volume-d23d8567-225b-4642-8412-1c1368895093', 'volume_size': 1, 'image_id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f111d55abd084743b16b1c60d303fb2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c89b049d-8e9b-40a2-9350-466dd874c3a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:33 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f92af96-3e9f-44e9-8693-e8de615ca125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:33 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f92af96-3e9f-44e9-8693-e8de615ca125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:33 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30b36ad-2a8c-4a3e-a047-0697a507747b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:33 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Volume d23d8567-225b-4642-8412-1c1368895093: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d23d8567-225b-4642-8412-1c1368895093', 'volume_size': 1, 'image_id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f111d55abd084743b16b1c60d303fb2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c89b049d-8e9b-40a2-9350-466dd874c3a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 20:08:33 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Trying to clone d23d8567-225b-4642-8412-1c1368895093 from image c89b049d-8e9b-40a2-9350-466dd874c3a8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}]). {{(pid=82989) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 20:08:33 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_s9xk8184devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82989) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 20:08:33 devstack cinder-volume[82989]: INFO cinder.image.image_utils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Image download 20.69 MB at 20.69 MB/s Apr 15 20:08:33 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15f4c80-7455-4474-bec9-3881db9d955f]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_s9xk8184devstack@QuobyteHD {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:33 devstack sudo[86531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_s9xk8184devstack@QuobyteHD Apr 15 20:08:33 devstack sudo[86531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:34 devstack sudo[86531]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_s9xk8184devstack@QuobyteHD" returned: 0 in 0.519s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:34 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Temporary image c89b049d-8e9b-40a2-9350-466dd874c3a8 is fetched for user b2cefbbe44fe47418192b0b2d636c965. {{(pid=82989) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 20:08:34 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a90cd7-17e8-412a-957a-c64dac586626]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_s9xk8184devstack@QuobyteHD {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:34 devstack sudo[86538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_s9xk8184devstack@QuobyteHD Apr 15 20:08:34 devstack sudo[86538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:34 devstack sudo[86538]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_s9xk8184devstack@QuobyteHD" returned: 0 in 0.622s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1889749673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d23d8567-225b-4642-8412-1c1368895093,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e827dca35b45461d958ad9e8cf1ad1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:33Z,use_quota=True,user_id='b2cefbbe44fe47418192b0b2d636c965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:08:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Creating volume d23d8567-225b-4642-8412-1c1368895093 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:08:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:08:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:08:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:08:34 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:08:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:34 devstack sudo[86543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093 1073741824 Apr 15 20:08:34 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:35 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093 1073741824" returned: 0 in 0.871s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:35 devstack sudo[86576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093 Apr 15 20:08:35 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:36 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093" returned: 0 in 0.643s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:36 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:08:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:36 devstack cinder-volume[82989]: DEBUG cinder.volume.volume_utils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Attempting download of c89b049d-8e9b-40a2-9350-466dd874c3a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}])) to volume d23d8567-225b-4642-8412-1c1368895093. {{(pid=82989) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 20:08:36 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5eec30-f0e1-4642-aa32-cbaa1e28f312]: (4, 'raw') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_99gtfr8j {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:36 devstack sudo[86589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_99gtfr8j Apr 15 20:08:36 devstack sudo[86589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:37 devstack sudo[86589]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_99gtfr8j" returned: 0 in 0.603s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_99gtfr8j {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:37 devstack sudo[86593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_99gtfr8j Apr 15 20:08:37 devstack sudo[86593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:37 devstack sudo[86593]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_99gtfr8j" returned: 1 in 0.725s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_99gtfr8j' failed. Not Retrying. {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 20:08:37 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce19cb5-9c48-47b2-978c-2b32813b91d8]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_s9xk8184devstack@QuobyteHD {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:38 devstack sudo[86622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_s9xk8184devstack@QuobyteHD Apr 15 20:08:38 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:38 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_s9xk8184devstack@QuobyteHD" returned: 0 in 0.841s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:38 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] c89b049d-8e9b-40a2-9350-466dd874c3a8 was qcow2, converting to raw {{(pid=82989) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 20:08:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_s9xk8184devstack@QuobyteHD /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:38 devstack sudo[86630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_s9xk8184devstack@QuobyteHD /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093 Apr 15 20:08:38 devstack sudo[86630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:40 devstack sudo[86630]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_s9xk8184devstack@QuobyteHD /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093" returned: 0 in 1.763s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:40 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_s9xk8184devstack@QuobyteHD, size 112.00 MB, duration 1.76 sec, destination /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093 {{(pid=82989) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 20:08:40 devstack cinder-volume[82989]: INFO cinder.image.image_utils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Converted 112.00 MB image at 63.49 MB/s Apr 15 20:08:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:40 devstack sudo[86640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093 1G Apr 15 20:08:40 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:40 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093 1G" returned: 0 in 0.523s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:41 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4339eb-1b43-4670-af6e-69532b5aa7a8]: (4, 'raw') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:41 devstack sudo[86645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093 Apr 15 20:08:41 devstack sudo[86645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:41 devstack sudo[86645]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093" returned: 0 in 0.820s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:41 devstack sudo[86649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093 Apr 15 20:08:41 devstack sudo[86649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:42 devstack sudo[86649]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093" returned: 1 in 0.556s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093' failed. Not Retrying. {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 20:08:42 devstack cinder-volume[82989]: DEBUG cinder.volume.volume_utils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Downloaded image c89b049d-8e9b-40a2-9350-466dd874c3a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}])) to volume d23d8567-225b-4642-8412-1c1368895093 successfully. {{(pid=82989) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 20:08:42 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Temporary image c89b049d-8e9b-40a2-9350-466dd874c3a8 for user b2cefbbe44fe47418192b0b2d636c965 is deleted. {{(pid=82989) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 20:08:42 devstack cinder-volume[82989]: DEBUG cinder.volume.volume_utils [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Marking volume d23d8567-225b-4642-8412-1c1368895093 as bootable. {{(pid=82989) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 20:08:42 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Copying metadata from image c89b049d-8e9b-40a2-9350-466dd874c3a8 to d23d8567-225b-4642-8412-1c1368895093. {{(pid=82989) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 20:08:42 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Creating volume glance metadata for volume d23d8567-225b-4642-8412-1c1368895093 backed by image c89b049d-8e9b-40a2-9350-466dd874c3a8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82989) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 20:08:42 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30b36ad-2a8c-4a3e-a047-0697a507747b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d23d8567-225b-4642-8412-1c1368895093', 'volume_size': 1, 'image_id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f111d55abd084743b16b1c60d303fb2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c89b049d-8e9b-40a2-9350-466dd874c3a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:42 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472365d7-92a7-4de7-9ef1-a39e33e0a3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:42 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Volume volume-d23d8567-225b-4642-8412-1c1368895093 (d23d8567-225b-4642-8412-1c1368895093): created successfully Apr 15 20:08:42 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472365d7-92a7-4de7-9ef1-a39e33e0a3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:42 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Flow 'volume_create_manager' (edd56eb9-3754-4864-a154-c8abf5c7f027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:08:42 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-755e5bba-0276-4375-9337-41f06cdaae42 tempest-VolumesGetTest-1330055057 None] Created volume successfully. Apr 15 20:08:43 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:08:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Flow 'volume_create_manager' (e4c5eccf-cad6-4ab3-9d78-122220d962a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:08:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4d5f5f-9d8f-4592-a908-d7cdc4999791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4d5f5f-9d8f-4592-a908-d7cdc4999791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:08:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1556842135',display_name='tempest-VolumesGetTest-Volume-1365045543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c2d37b-ea1f-4bee-87e2-91ef08affea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e827dca35b45461d958ad9e8cf1ad1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:44Z,use_quota=True,user_id='b2cefbbe44fe47418192b0b2d636c965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e03e3f-429f-46b5-a2c7-b464bea2446b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e03e3f-429f-46b5-a2c7-b464bea2446b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc30ef7-3270-42f2-9937-58a896a4f706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc30ef7-3270-42f2-9937-58a896a4f706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21c2d37b-ea1f-4bee-87e2-91ef08affea7', 'volume_name': 'volume-21c2d37b-ea1f-4bee-87e2-91ef08affea7', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9273986b-3e72-4b68-94d8-bac9af4a0867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9273986b-3e72-4b68-94d8-bac9af4a0867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2b3d296-8692-497f-892e-294f7ad31a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:43 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Volume 21c2d37b-ea1f-4bee-87e2-91ef08affea7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21c2d37b-ea1f-4bee-87e2-91ef08affea7', 'volume_size': 1} Apr 15 20:08:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:08:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1556842135',display_name='tempest-VolumesGetTest-Volume-1365045543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c2d37b-ea1f-4bee-87e2-91ef08affea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e827dca35b45461d958ad9e8cf1ad1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:44Z,use_quota=True,user_id='b2cefbbe44fe47418192b0b2d636c965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:08:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Creating volume 21c2d37b-ea1f-4bee-87e2-91ef08affea7 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:08:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:08:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:08:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:08:43 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:08:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-21c2d37b-ea1f-4bee-87e2-91ef08affea7 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:43 devstack sudo[86655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-21c2d37b-ea1f-4bee-87e2-91ef08affea7 1073741824 Apr 15 20:08:43 devstack sudo[86655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:44 devstack sudo[86655]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-21c2d37b-ea1f-4bee-87e2-91ef08affea7 1073741824" returned: 0 in 0.808s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-21c2d37b-ea1f-4bee-87e2-91ef08affea7 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:44 devstack sudo[86685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-21c2d37b-ea1f-4bee-87e2-91ef08affea7 Apr 15 20:08:44 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:45 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-21c2d37b-ea1f-4bee-87e2-91ef08affea7" returned: 0 in 0.469s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:45 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:08:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2b3d296-8692-497f-892e-294f7ad31a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21c2d37b-ea1f-4bee-87e2-91ef08affea7', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260ac0c5-f774-4694-b81c-3bbc8f33a313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:45 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Volume volume-21c2d37b-ea1f-4bee-87e2-91ef08affea7 (21c2d37b-ea1f-4bee-87e2-91ef08affea7): created successfully Apr 15 20:08:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260ac0c5-f774-4694-b81c-3bbc8f33a313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Flow 'volume_create_manager' (e4c5eccf-cad6-4ab3-9d78-122220d962a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:08:45 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-82f67a22-140e-4e5f-bbfa-97cb539f9206 tempest-VolumesGetTest-1330055057 None] Created volume successfully. Apr 15 20:08:45 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-186d10cb-b75b-4a15-94eb-54cb760f94ee tempest-VolumesGetTest-1330055057 None] Acquiring lock "cinder-21c2d37b-ea1f-4bee-87e2-91ef08affea7-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:08:45 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-186d10cb-b75b-4a15-94eb-54cb760f94ee tempest-VolumesGetTest-1330055057 None] Lock "cinder-21c2d37b-ea1f-4bee-87e2-91ef08affea7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:08:45 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-186d10cb-b75b-4a15-94eb-54cb760f94ee tempest-VolumesGetTest-1330055057 None] Acquiring lock "cinder-quobyte-21c2d37b-ea1f-4bee-87e2-91ef08affea7" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:08:45 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-186d10cb-b75b-4a15-94eb-54cb760f94ee tempest-VolumesGetTest-1330055057 None] Lock "cinder-quobyte-21c2d37b-ea1f-4bee-87e2-91ef08affea7" acquired by "delete_volume" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:08:45 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9043844-91d1-4e2f-a3c9-76dd6651290c]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-186d10cb-b75b-4a15-94eb-54cb760f94ee tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-21c2d37b-ea1f-4bee-87e2-91ef08affea7 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:46 devstack sudo[86694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-21c2d37b-ea1f-4bee-87e2-91ef08affea7 Apr 15 20:08:46 devstack sudo[86694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:46 devstack sudo[86694]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-186d10cb-b75b-4a15-94eb-54cb760f94ee tempest-VolumesGetTest-1330055057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-21c2d37b-ea1f-4bee-87e2-91ef08affea7" returned: 0 in 0.651s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-186d10cb-b75b-4a15-94eb-54cb760f94ee tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-21c2d37b-ea1f-4bee-87e2-91ef08affea7 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:46 devstack sudo[86700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-21c2d37b-ea1f-4bee-87e2-91ef08affea7 Apr 15 20:08:46 devstack sudo[86700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:47 devstack sudo[86700]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-186d10cb-b75b-4a15-94eb-54cb760f94ee tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-21c2d37b-ea1f-4bee-87e2-91ef08affea7" returned: 0 in 0.579s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:47 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-186d10cb-b75b-4a15-94eb-54cb760f94ee tempest-VolumesGetTest-1330055057 None] Lock "cinder-quobyte-21c2d37b-ea1f-4bee-87e2-91ef08affea7" released by "delete_volume" :: held 1.275s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:08:47 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-186d10cb-b75b-4a15-94eb-54cb760f94ee tempest-VolumesGetTest-1330055057 None] Created reservations ['9764acb4-6c46-4ae6-902b-8f043020b887', 'c1f29e52-2cea-4a7d-8b91-0042a4f80bd6', '089e1215-6e0c-4e75-8b45-1826a1b6a4e5', '232c9c9b-8fab-40c4-8724-cadafe9683d7'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:08:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-186d10cb-b75b-4a15-94eb-54cb760f94ee tempest-VolumesGetTest-1330055057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-186d10cb-b75b-4a15-94eb-54cb760f94ee tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:47 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-186d10cb-b75b-4a15-94eb-54cb760f94ee tempest-VolumesGetTest-1330055057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:08:47 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-186d10cb-b75b-4a15-94eb-54cb760f94ee tempest-VolumesGetTest-1330055057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:08:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-186d10cb-b75b-4a15-94eb-54cb760f94ee tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-186d10cb-b75b-4a15-94eb-54cb760f94ee tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:47 devstack sudo[86703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:08:47 devstack sudo[86703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:47 devstack sudo[86703]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-186d10cb-b75b-4a15-94eb-54cb760f94ee tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.547s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:47 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-186d10cb-b75b-4a15-94eb-54cb760f94ee tempest-VolumesGetTest-1330055057 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:08:47 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-186d10cb-b75b-4a15-94eb-54cb760f94ee tempest-VolumesGetTest-1330055057 None] Deleted volume successfully. Apr 15 20:08:47 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-186d10cb-b75b-4a15-94eb-54cb760f94ee tempest-VolumesGetTest-1330055057 None] Lock "cinder-21c2d37b-ea1f-4bee-87e2-91ef08affea7-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:08:48 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2f3d28e8-6a53-4de1-bd0f-4228b37d3aeb tempest-VolumesGetTest-1330055057 None] Acquiring lock "cinder-d23d8567-225b-4642-8412-1c1368895093-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:08:48 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2f3d28e8-6a53-4de1-bd0f-4228b37d3aeb tempest-VolumesGetTest-1330055057 None] Lock "cinder-d23d8567-225b-4642-8412-1c1368895093-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:08:48 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2f3d28e8-6a53-4de1-bd0f-4228b37d3aeb tempest-VolumesGetTest-1330055057 None] Acquiring lock "cinder-quobyte-d23d8567-225b-4642-8412-1c1368895093" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:08:48 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2f3d28e8-6a53-4de1-bd0f-4228b37d3aeb tempest-VolumesGetTest-1330055057 None] Lock "cinder-quobyte-d23d8567-225b-4642-8412-1c1368895093" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:08:48 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bab1bb-eece-4ba0-a054-69eede8faf16]: (4, 'raw') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:08:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2f3d28e8-6a53-4de1-bd0f-4228b37d3aeb tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:48 devstack sudo[86708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093 Apr 15 20:08:48 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:48 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2f3d28e8-6a53-4de1-bd0f-4228b37d3aeb tempest-VolumesGetTest-1330055057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093" returned: 0 in 0.580s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2f3d28e8-6a53-4de1-bd0f-4228b37d3aeb tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:48 devstack sudo[86712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093 Apr 15 20:08:48 devstack sudo[86712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:49 devstack sudo[86712]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2f3d28e8-6a53-4de1-bd0f-4228b37d3aeb tempest-VolumesGetTest-1330055057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093" returned: 1 in 0.994s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2f3d28e8-6a53-4de1-bd0f-4228b37d3aeb tempest-VolumesGetTest-1330055057 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093' failed. Not Retrying. {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 20:08:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2f3d28e8-6a53-4de1-bd0f-4228b37d3aeb tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:49 devstack sudo[86746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093 Apr 15 20:08:49 devstack sudo[86746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:50 devstack sudo[86746]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2f3d28e8-6a53-4de1-bd0f-4228b37d3aeb tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d23d8567-225b-4642-8412-1c1368895093" returned: 0 in 0.476s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:50 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2f3d28e8-6a53-4de1-bd0f-4228b37d3aeb tempest-VolumesGetTest-1330055057 None] Lock "cinder-quobyte-d23d8567-225b-4642-8412-1c1368895093" released by "delete_volume" :: held 2.101s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:08:50 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-2f3d28e8-6a53-4de1-bd0f-4228b37d3aeb tempest-VolumesGetTest-1330055057 None] Created reservations ['be501319-d867-45f1-ae2f-625b0310a0f7', '7737e876-4c13-4b6f-84ae-cbdf9f9a4701', '32bf7f03-1330-48fb-a6d2-9f18827bdd40', '3812e033-a697-44d3-953e-deef925a1b36'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:08:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2f3d28e8-6a53-4de1-bd0f-4228b37d3aeb tempest-VolumesGetTest-1330055057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2f3d28e8-6a53-4de1-bd0f-4228b37d3aeb tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:50 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2f3d28e8-6a53-4de1-bd0f-4228b37d3aeb tempest-VolumesGetTest-1330055057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:08:50 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2f3d28e8-6a53-4de1-bd0f-4228b37d3aeb tempest-VolumesGetTest-1330055057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:08:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2f3d28e8-6a53-4de1-bd0f-4228b37d3aeb tempest-VolumesGetTest-1330055057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2f3d28e8-6a53-4de1-bd0f-4228b37d3aeb tempest-VolumesGetTest-1330055057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:50 devstack sudo[86750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:08:50 devstack sudo[86750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:51 devstack sudo[86750]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2f3d28e8-6a53-4de1-bd0f-4228b37d3aeb tempest-VolumesGetTest-1330055057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.605s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-2f3d28e8-6a53-4de1-bd0f-4228b37d3aeb tempest-VolumesGetTest-1330055057 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:08:51 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-2f3d28e8-6a53-4de1-bd0f-4228b37d3aeb tempest-VolumesGetTest-1330055057 None] Deleted volume successfully. Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2f3d28e8-6a53-4de1-bd0f-4228b37d3aeb tempest-VolumesGetTest-1330055057 None] Lock "cinder-d23d8567-225b-4642-8412-1c1368895093-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Flow 'volume_create_manager' (a53bd38a-4d27-436e-bac7-d296edf77b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d9ee0e-fef7-40ae-9485-fbf912f198c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d9ee0e-fef7-40ae-9485-fbf912f198c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-548267285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e52920-a180-4319-8e70-e032e0ea35dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f57da32dc704fb4a8ee2087caa688d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:52Z,use_quota=True,user_id='1a107bdaab564b39bb18782b9400de5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e8f1fe4-0f74-4c50-b14f-9a7c84148b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e8f1fe4-0f74-4c50-b14f-9a7c84148b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0752353-11c9-47ff-a3b1-e6b8da591938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0752353-11c9-47ff-a3b1-e6b8da591938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81e52920-a180-4319-8e70-e032e0ea35dc', 'volume_name': 'volume-81e52920-a180-4319-8e70-e032e0ea35dc', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac593601-5192-4e50-9e2a-6218a89b99b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac593601-5192-4e50-9e2a-6218a89b99b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd15dae-f97a-41a3-8a73-14052c08b14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:51 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Volume 81e52920-a180-4319-8e70-e032e0ea35dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81e52920-a180-4319-8e70-e032e0ea35dc', 'volume_size': 1} Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-548267285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e52920-a180-4319-8e70-e032e0ea35dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f57da32dc704fb4a8ee2087caa688d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:52Z,use_quota=True,user_id='1a107bdaab564b39bb18782b9400de5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Creating volume 81e52920-a180-4319-8e70-e032e0ea35dc {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:08:51 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:08:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e52920-a180-4319-8e70-e032e0ea35dc 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:51 devstack sudo[86754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e52920-a180-4319-8e70-e032e0ea35dc 1073741824 Apr 15 20:08:51 devstack sudo[86754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e52920-a180-4319-8e70-e032e0ea35dc 1073741824" returned: 0 in 0.861s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:52 devstack sudo[86754]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e52920-a180-4319-8e70-e032e0ea35dc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:52 devstack sudo[86760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e52920-a180-4319-8e70-e032e0ea35dc Apr 15 20:08:52 devstack sudo[86760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:53 devstack sudo[86760]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e52920-a180-4319-8e70-e032e0ea35dc" returned: 0 in 1.114s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:53 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] <== create_volume: return (2045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:08:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:53 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd15dae-f97a-41a3-8a73-14052c08b14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81e52920-a180-4319-8e70-e032e0ea35dc', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:53 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecd3b2d-f5af-4649-8bfe-d16340c9deb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:53 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Volume volume-81e52920-a180-4319-8e70-e032e0ea35dc (81e52920-a180-4319-8e70-e032e0ea35dc): created successfully Apr 15 20:08:53 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecd3b2d-f5af-4649-8bfe-d16340c9deb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:53 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Flow 'volume_create_manager' (a53bd38a-4d27-436e-bac7-d296edf77b04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:08:53 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-e6647aa6-9203-44fe-a7b8-1d721e5e2b8c tempest-ServerRescueNegativeTestJSON-1201192591 None] Created volume successfully. Apr 15 20:08:54 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:08:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Flow 'volume_create_manager' (af9d0239-8ba7-4100-a1dd-2e8c38159738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:08:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a7749f3-6538-41e4-8b48-f6abfac7acb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a7749f3-6538-41e4-8b48-f6abfac7acb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1903460261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd0d5b81-51dc-4423-831b-ab3e41322554,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c257160a4c534e25befa587e9f60446c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:54Z,use_quota=True,user_id='c40e9c99c59141a99e0a9ec931515815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10aca0bc-1941-4b6d-8bdc-8862776db692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10aca0bc-1941-4b6d-8bdc-8862776db692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9148a413-be80-4111-9048-d189fc3ded24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9148a413-be80-4111-9048-d189fc3ded24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd0d5b81-51dc-4423-831b-ab3e41322554', 'volume_name': 'volume-cd0d5b81-51dc-4423-831b-ab3e41322554', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8fc4d7-5765-43cc-9cb7-b461479dc8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8fc4d7-5765-43cc-9cb7-b461479dc8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8119115-e39a-487e-8b74-7be0cb8fc633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:54 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Volume cd0d5b81-51dc-4423-831b-ab3e41322554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd0d5b81-51dc-4423-831b-ab3e41322554', 'volume_size': 1} Apr 15 20:08:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:54 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1903460261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd0d5b81-51dc-4423-831b-ab3e41322554,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c257160a4c534e25befa587e9f60446c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:54Z,use_quota=True,user_id='c40e9c99c59141a99e0a9ec931515815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:08:54 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Creating volume cd0d5b81-51dc-4423-831b-ab3e41322554 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:08:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:54 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:08:54 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:08:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:54 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:08:54 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:08:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cd0d5b81-51dc-4423-831b-ab3e41322554 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:54 devstack sudo[86763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cd0d5b81-51dc-4423-831b-ab3e41322554 1073741824 Apr 15 20:08:54 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:55 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cd0d5b81-51dc-4423-831b-ab3e41322554 1073741824" returned: 0 in 0.951s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cd0d5b81-51dc-4423-831b-ab3e41322554 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:55 devstack sudo[86770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cd0d5b81-51dc-4423-831b-ab3e41322554 Apr 15 20:08:55 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:56 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cd0d5b81-51dc-4423-831b-ab3e41322554" returned: 0 in 0.763s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:56 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:08:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8119115-e39a-487e-8b74-7be0cb8fc633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd0d5b81-51dc-4423-831b-ab3e41322554', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4baef07e-8ecc-40e7-b8d9-3395fdf56e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:56 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Volume volume-cd0d5b81-51dc-4423-831b-ab3e41322554 (cd0d5b81-51dc-4423-831b-ab3e41322554): created successfully Apr 15 20:08:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4baef07e-8ecc-40e7-b8d9-3395fdf56e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Flow 'volume_create_manager' (af9d0239-8ba7-4100-a1dd-2e8c38159738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:08:56 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-7d4f7e25-7cf2-435d-b772-6fefe7936ceb tempest-VolumesListTestJSON-1271806904 None] Created volume successfully. Apr 15 20:08:57 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:08:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Flow 'volume_create_manager' (3915286f-0101-4a44-a23d-930e9b8c587a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:08:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6413e41-ac49-43d3-b519-5ef3947bbc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6413e41-ac49-43d3-b519-5ef3947bbc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-593685754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c257160a4c534e25befa587e9f60446c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:57Z,use_quota=True,user_id='c40e9c99c59141a99e0a9ec931515815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236d6508-7e9c-4755-8560-ce6953e3c6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236d6508-7e9c-4755-8560-ce6953e3c6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f181c9d-2526-4352-a3a5-ce890cf0f882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f181c9d-2526-4352-a3a5-ce890cf0f882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0', 'volume_name': 'volume-53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618192c2-4906-41f0-92eb-97e8beed61e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618192c2-4906-41f0-92eb-97e8beed61e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91f7c40-53bc-4480-8c28-1d91f3fe252b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:57 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Volume 53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0', 'volume_size': 1} Apr 15 20:08:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:57 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-593685754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c257160a4c534e25befa587e9f60446c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:08:57Z,use_quota=True,user_id='c40e9c99c59141a99e0a9ec931515815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:08:57 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Creating volume 53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:08:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:57 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:08:57 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:08:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:57 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:08:57 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:08:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:57 devstack sudo[86774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0 1073741824 Apr 15 20:08:57 devstack sudo[86774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:58 devstack sudo[86774]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0 1073741824" returned: 0 in 0.750s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:58 devstack sudo[86783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0 Apr 15 20:08:58 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:08:59 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0" returned: 0 in 0.524s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91f7c40-53bc-4480-8c28-1d91f3fe252b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a291d68-7df0-44bd-89a1-5703b2566a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:59 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Volume volume-53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0 (53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0): created successfully Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a291d68-7df0-44bd-89a1-5703b2566a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Flow 'volume_create_manager' (3915286f-0101-4a44-a23d-930e9b8c587a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:08:59 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-e30812c5-4d19-4f6a-84c1-b4d3287b4028 tempest-VolumesListTestJSON-1271806904 None] Created volume successfully. Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Flow 'volume_create_manager' (1c1e8fb7-fbe0-4cef-8404-cd5fd3480165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428d17d9-d2bb-4c69-961e-db3514e569b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428d17d9-d2bb-4c69-961e-db3514e569b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-370106799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=811c9a1d-af0a-4ded-9516-be8c0a1e6d1f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c257160a4c534e25befa587e9f60446c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:00Z,use_quota=True,user_id='c40e9c99c59141a99e0a9ec931515815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bff1b3d1-be84-47f4-a29c-3f7c5b58fc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bff1b3d1-be84-47f4-a29c-3f7c5b58fc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760f7489-91e0-40f4-bba3-b8c71b0566a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760f7489-91e0-40f4-bba3-b8c71b0566a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '811c9a1d-af0a-4ded-9516-be8c0a1e6d1f', 'volume_name': 'volume-811c9a1d-af0a-4ded-9516-be8c0a1e6d1f', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86495d9-b94a-4184-a321-187ab175dbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86495d9-b94a-4184-a321-187ab175dbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87e07c3-7f35-4351-b965-868f083db006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:08:59 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Volume 811c9a1d-af0a-4ded-9516-be8c0a1e6d1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-811c9a1d-af0a-4ded-9516-be8c0a1e6d1f', 'volume_size': 1} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-370106799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=811c9a1d-af0a-4ded-9516-be8c0a1e6d1f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c257160a4c534e25befa587e9f60446c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:00Z,use_quota=True,user_id='c40e9c99c59141a99e0a9ec931515815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Creating volume 811c9a1d-af0a-4ded-9516-be8c0a1e6d1f {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:08:59 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:08:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-811c9a1d-af0a-4ded-9516-be8c0a1e6d1f 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:08:59 devstack sudo[86812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-811c9a1d-af0a-4ded-9516-be8c0a1e6d1f 1073741824 Apr 15 20:08:59 devstack sudo[86812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:00 devstack sudo[86812]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-811c9a1d-af0a-4ded-9516-be8c0a1e6d1f 1073741824" returned: 0 in 0.493s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-811c9a1d-af0a-4ded-9516-be8c0a1e6d1f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:00 devstack sudo[86823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-811c9a1d-af0a-4ded-9516-be8c0a1e6d1f Apr 15 20:09:00 devstack sudo[86823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:00 devstack sudo[86823]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-811c9a1d-af0a-4ded-9516-be8c0a1e6d1f" returned: 0 in 0.447s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:09:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87e07c3-7f35-4351-b965-868f083db006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-811c9a1d-af0a-4ded-9516-be8c0a1e6d1f', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6ad5ece-e1d4-4cb5-a842-ed787f8e424a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:00 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Volume volume-811c9a1d-af0a-4ded-9516-be8c0a1e6d1f (811c9a1d-af0a-4ded-9516-be8c0a1e6d1f): created successfully Apr 15 20:09:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6ad5ece-e1d4-4cb5-a842-ed787f8e424a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Flow 'volume_create_manager' (1c1e8fb7-fbe0-4cef-8404-cd5fd3480165) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:00 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-757ccffa-8c32-49c7-b666-5ac8c847d63a tempest-VolumesListTestJSON-1271806904 None] Created volume successfully. Apr 15 20:09:04 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3a9d38b8-7ce0-4a9d-8a04-770f47a7171d tempest-VolumesListTestJSON-1271806904 None] Acquiring lock "cinder-811c9a1d-af0a-4ded-9516-be8c0a1e6d1f-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:04 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3a9d38b8-7ce0-4a9d-8a04-770f47a7171d tempest-VolumesListTestJSON-1271806904 None] Lock "cinder-811c9a1d-af0a-4ded-9516-be8c0a1e6d1f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:04 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3a9d38b8-7ce0-4a9d-8a04-770f47a7171d tempest-VolumesListTestJSON-1271806904 None] Acquiring lock "cinder-quobyte-811c9a1d-af0a-4ded-9516-be8c0a1e6d1f" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:04 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3a9d38b8-7ce0-4a9d-8a04-770f47a7171d tempest-VolumesListTestJSON-1271806904 None] Lock "cinder-quobyte-811c9a1d-af0a-4ded-9516-be8c0a1e6d1f" acquired by "delete_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:04 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d50c9b-3e83-4015-9a7d-f8105c659090]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:09:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3a9d38b8-7ce0-4a9d-8a04-770f47a7171d tempest-VolumesListTestJSON-1271806904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-811c9a1d-af0a-4ded-9516-be8c0a1e6d1f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:04 devstack sudo[86865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-811c9a1d-af0a-4ded-9516-be8c0a1e6d1f Apr 15 20:09:04 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:05 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3a9d38b8-7ce0-4a9d-8a04-770f47a7171d tempest-VolumesListTestJSON-1271806904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-811c9a1d-af0a-4ded-9516-be8c0a1e6d1f" returned: 0 in 1.100s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3a9d38b8-7ce0-4a9d-8a04-770f47a7171d tempest-VolumesListTestJSON-1271806904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-811c9a1d-af0a-4ded-9516-be8c0a1e6d1f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:05 devstack sudo[86878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-811c9a1d-af0a-4ded-9516-be8c0a1e6d1f Apr 15 20:09:05 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:06 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3a9d38b8-7ce0-4a9d-8a04-770f47a7171d tempest-VolumesListTestJSON-1271806904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-811c9a1d-af0a-4ded-9516-be8c0a1e6d1f" returned: 0 in 0.646s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:06 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3a9d38b8-7ce0-4a9d-8a04-770f47a7171d tempest-VolumesListTestJSON-1271806904 None] Lock "cinder-quobyte-811c9a1d-af0a-4ded-9516-be8c0a1e6d1f" released by "delete_volume" :: held 1.787s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:06 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-3a9d38b8-7ce0-4a9d-8a04-770f47a7171d tempest-VolumesListTestJSON-1271806904 None] Created reservations ['47c82d7b-2ecc-4811-8299-77cb303e0ccd', '0ca94cb3-4246-4d4e-9e3c-5f0e7b5767fd', '74be3613-334a-44ab-a184-5e7ab457888f', 'e8d053b0-741c-4b66-b02c-7f08f706571d'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:09:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3a9d38b8-7ce0-4a9d-8a04-770f47a7171d tempest-VolumesListTestJSON-1271806904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3a9d38b8-7ce0-4a9d-8a04-770f47a7171d tempest-VolumesListTestJSON-1271806904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:06 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3a9d38b8-7ce0-4a9d-8a04-770f47a7171d tempest-VolumesListTestJSON-1271806904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:06 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3a9d38b8-7ce0-4a9d-8a04-770f47a7171d tempest-VolumesListTestJSON-1271806904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3a9d38b8-7ce0-4a9d-8a04-770f47a7171d tempest-VolumesListTestJSON-1271806904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3a9d38b8-7ce0-4a9d-8a04-770f47a7171d tempest-VolumesListTestJSON-1271806904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:06 devstack sudo[86893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:09:06 devstack sudo[86893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:06 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3d0b6386-c06f-4e70-b778-6604528f5af1 tempest-VolumesListTestJSON-1271806904 None] Acquiring lock "cinder-53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:06 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3d0b6386-c06f-4e70-b778-6604528f5af1 tempest-VolumesListTestJSON-1271806904 None] Lock "cinder-53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:06 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3d0b6386-c06f-4e70-b778-6604528f5af1 tempest-VolumesListTestJSON-1271806904 None] Acquiring lock "cinder-quobyte-53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:06 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3d0b6386-c06f-4e70-b778-6604528f5af1 tempest-VolumesListTestJSON-1271806904 None] Lock "cinder-quobyte-53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0" acquired by "delete_volume" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:06 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[08724967-dc1c-4255-939f-911cfc6b90ec]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:09:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3d0b6386-c06f-4e70-b778-6604528f5af1 tempest-VolumesListTestJSON-1271806904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:06 devstack sudo[86893]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3a9d38b8-7ce0-4a9d-8a04-770f47a7171d tempest-VolumesListTestJSON-1271806904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.489s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:06 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-3a9d38b8-7ce0-4a9d-8a04-770f47a7171d tempest-VolumesListTestJSON-1271806904 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:09:06 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-3a9d38b8-7ce0-4a9d-8a04-770f47a7171d tempest-VolumesListTestJSON-1271806904 None] Deleted volume successfully. Apr 15 20:09:06 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3a9d38b8-7ce0-4a9d-8a04-770f47a7171d tempest-VolumesListTestJSON-1271806904 None] Lock "cinder-811c9a1d-af0a-4ded-9516-be8c0a1e6d1f-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:06 devstack sudo[86896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0 Apr 15 20:09:06 devstack sudo[86896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:07 devstack sudo[86896]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3d0b6386-c06f-4e70-b778-6604528f5af1 tempest-VolumesListTestJSON-1271806904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0" returned: 0 in 0.822s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3d0b6386-c06f-4e70-b778-6604528f5af1 tempest-VolumesListTestJSON-1271806904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:07 devstack sudo[86901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0 Apr 15 20:09:07 devstack sudo[86901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:08 devstack sudo[86901]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3d0b6386-c06f-4e70-b778-6604528f5af1 tempest-VolumesListTestJSON-1271806904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0" returned: 0 in 0.453s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:08 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3d0b6386-c06f-4e70-b778-6604528f5af1 tempest-VolumesListTestJSON-1271806904 None] Lock "cinder-quobyte-53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0" released by "delete_volume" :: held 1.307s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:08 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-3d0b6386-c06f-4e70-b778-6604528f5af1 tempest-VolumesListTestJSON-1271806904 None] Created reservations ['708878ea-c877-4186-9786-3ef2a14eec20', '673a16f6-5318-46f8-9ba2-293a25f0ec3c', '785c275c-88e9-4ee3-b3f0-df633fdb00b2', '78036850-1d90-46cf-b94d-95e0cfee0a4f'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:09:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3d0b6386-c06f-4e70-b778-6604528f5af1 tempest-VolumesListTestJSON-1271806904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3d0b6386-c06f-4e70-b778-6604528f5af1 tempest-VolumesListTestJSON-1271806904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:08 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3d0b6386-c06f-4e70-b778-6604528f5af1 tempest-VolumesListTestJSON-1271806904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:08 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3d0b6386-c06f-4e70-b778-6604528f5af1 tempest-VolumesListTestJSON-1271806904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3d0b6386-c06f-4e70-b778-6604528f5af1 tempest-VolumesListTestJSON-1271806904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3d0b6386-c06f-4e70-b778-6604528f5af1 tempest-VolumesListTestJSON-1271806904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:08 devstack sudo[86938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:09:08 devstack sudo[86938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:08 devstack sudo[86938]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3d0b6386-c06f-4e70-b778-6604528f5af1 tempest-VolumesListTestJSON-1271806904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.552s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:08 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-3d0b6386-c06f-4e70-b778-6604528f5af1 tempest-VolumesListTestJSON-1271806904 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:09:08 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-3d0b6386-c06f-4e70-b778-6604528f5af1 tempest-VolumesListTestJSON-1271806904 None] Deleted volume successfully. Apr 15 20:09:08 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3d0b6386-c06f-4e70-b778-6604528f5af1 tempest-VolumesListTestJSON-1271806904 None] Lock "cinder-53a8afa0-4a90-4bd6-b6d5-1bb20296d4c0-delete_volume" released by "delete_volume" :: held 2.062s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:08 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b738e602-5bd3-477f-87d4-1b0de1897526 tempest-VolumesListTestJSON-1271806904 None] Acquiring lock "cinder-cd0d5b81-51dc-4423-831b-ab3e41322554-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:08 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b738e602-5bd3-477f-87d4-1b0de1897526 tempest-VolumesListTestJSON-1271806904 None] Lock "cinder-cd0d5b81-51dc-4423-831b-ab3e41322554-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:09 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b738e602-5bd3-477f-87d4-1b0de1897526 tempest-VolumesListTestJSON-1271806904 None] Acquiring lock "cinder-quobyte-cd0d5b81-51dc-4423-831b-ab3e41322554" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:09 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b738e602-5bd3-477f-87d4-1b0de1897526 tempest-VolumesListTestJSON-1271806904 None] Lock "cinder-quobyte-cd0d5b81-51dc-4423-831b-ab3e41322554" acquired by "delete_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:09 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b37167-5e7f-42f8-9b9c-70027f6cd772]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:09:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b738e602-5bd3-477f-87d4-1b0de1897526 tempest-VolumesListTestJSON-1271806904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cd0d5b81-51dc-4423-831b-ab3e41322554 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:09 devstack sudo[86975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cd0d5b81-51dc-4423-831b-ab3e41322554 Apr 15 20:09:09 devstack sudo[86975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:09 devstack sudo[86975]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b738e602-5bd3-477f-87d4-1b0de1897526 tempest-VolumesListTestJSON-1271806904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cd0d5b81-51dc-4423-831b-ab3e41322554" returned: 0 in 0.721s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b738e602-5bd3-477f-87d4-1b0de1897526 tempest-VolumesListTestJSON-1271806904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cd0d5b81-51dc-4423-831b-ab3e41322554 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:09 devstack sudo[87014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cd0d5b81-51dc-4423-831b-ab3e41322554 Apr 15 20:09:09 devstack sudo[87014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7ebf0743-f0d4-45c1-9f32-b6e8823e4b3c tempest-ServerRescueNegativeTestJSON-1201192591 None] Acquiring lock "cinder-81e52920-a180-4319-8e70-e032e0ea35dc-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7ebf0743-f0d4-45c1-9f32-b6e8823e4b3c tempest-ServerRescueNegativeTestJSON-1201192591 None] Lock "cinder-81e52920-a180-4319-8e70-e032e0ea35dc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7ebf0743-f0d4-45c1-9f32-b6e8823e4b3c tempest-ServerRescueNegativeTestJSON-1201192591 None] Acquiring lock "cinder-quobyte-81e52920-a180-4319-8e70-e032e0ea35dc" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7ebf0743-f0d4-45c1-9f32-b6e8823e4b3c tempest-ServerRescueNegativeTestJSON-1201192591 None] Lock "cinder-quobyte-81e52920-a180-4319-8e70-e032e0ea35dc" acquired by "delete_volume" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:10 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1e9c3e-e4c2-4ae3-a079-ab70f3fd0ac8]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:09:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7ebf0743-f0d4-45c1-9f32-b6e8823e4b3c tempest-ServerRescueNegativeTestJSON-1201192591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e52920-a180-4319-8e70-e032e0ea35dc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:10 devstack sudo[87014]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b738e602-5bd3-477f-87d4-1b0de1897526 tempest-VolumesListTestJSON-1271806904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cd0d5b81-51dc-4423-831b-ab3e41322554" returned: 0 in 0.739s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b738e602-5bd3-477f-87d4-1b0de1897526 tempest-VolumesListTestJSON-1271806904 None] Lock "cinder-quobyte-cd0d5b81-51dc-4423-831b-ab3e41322554" released by "delete_volume" :: held 1.487s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:10 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-b738e602-5bd3-477f-87d4-1b0de1897526 tempest-VolumesListTestJSON-1271806904 None] Created reservations ['0c64002e-620f-4f4f-a153-8c6ff1101ddc', '176ba572-e3d9-486c-a593-e25785641707', '7b5ef4c7-4d8e-4238-a2d3-a7aa946c04cb', '832c051b-a319-4d8f-ad38-69275baad1bb'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:09:10 devstack sudo[87018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e52920-a180-4319-8e70-e032e0ea35dc Apr 15 20:09:10 devstack sudo[87018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b738e602-5bd3-477f-87d4-1b0de1897526 tempest-VolumesListTestJSON-1271806904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b738e602-5bd3-477f-87d4-1b0de1897526 tempest-VolumesListTestJSON-1271806904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:10 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b738e602-5bd3-477f-87d4-1b0de1897526 tempest-VolumesListTestJSON-1271806904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:10 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b738e602-5bd3-477f-87d4-1b0de1897526 tempest-VolumesListTestJSON-1271806904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b738e602-5bd3-477f-87d4-1b0de1897526 tempest-VolumesListTestJSON-1271806904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b738e602-5bd3-477f-87d4-1b0de1897526 tempest-VolumesListTestJSON-1271806904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:10 devstack sudo[87044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:09:10 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:11 devstack sudo[87018]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7ebf0743-f0d4-45c1-9f32-b6e8823e4b3c tempest-ServerRescueNegativeTestJSON-1201192591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e52920-a180-4319-8e70-e032e0ea35dc" returned: 0 in 1.060s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7ebf0743-f0d4-45c1-9f32-b6e8823e4b3c tempest-ServerRescueNegativeTestJSON-1201192591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e52920-a180-4319-8e70-e032e0ea35dc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:11 devstack sudo[87052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e52920-a180-4319-8e70-e032e0ea35dc Apr 15 20:09:11 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:11 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b738e602-5bd3-477f-87d4-1b0de1897526 tempest-VolumesListTestJSON-1271806904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 1.078s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:11 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-b738e602-5bd3-477f-87d4-1b0de1897526 tempest-VolumesListTestJSON-1271806904 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:09:11 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-b738e602-5bd3-477f-87d4-1b0de1897526 tempest-VolumesListTestJSON-1271806904 None] Deleted volume successfully. Apr 15 20:09:11 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b738e602-5bd3-477f-87d4-1b0de1897526 tempest-VolumesListTestJSON-1271806904 None] Lock "cinder-cd0d5b81-51dc-4423-831b-ab3e41322554-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:12 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7ebf0743-f0d4-45c1-9f32-b6e8823e4b3c tempest-ServerRescueNegativeTestJSON-1201192591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e52920-a180-4319-8e70-e032e0ea35dc" returned: 0 in 0.591s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:12 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7ebf0743-f0d4-45c1-9f32-b6e8823e4b3c tempest-ServerRescueNegativeTestJSON-1201192591 None] Lock "cinder-quobyte-81e52920-a180-4319-8e70-e032e0ea35dc" released by "delete_volume" :: held 1.698s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:12 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-7ebf0743-f0d4-45c1-9f32-b6e8823e4b3c tempest-ServerRescueNegativeTestJSON-1201192591 None] Created reservations ['8a540a33-4c04-4272-8d79-2499de2725dd', 'e5f7393b-d038-47d0-b2ce-f053069eaeac', '0b37f135-24f2-479e-b4bb-ec5b2b44b764', 'ec8f978c-6f42-435f-8926-404c523f8c70'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:09:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7ebf0743-f0d4-45c1-9f32-b6e8823e4b3c tempest-ServerRescueNegativeTestJSON-1201192591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7ebf0743-f0d4-45c1-9f32-b6e8823e4b3c tempest-ServerRescueNegativeTestJSON-1201192591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:12 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7ebf0743-f0d4-45c1-9f32-b6e8823e4b3c tempest-ServerRescueNegativeTestJSON-1201192591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:12 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7ebf0743-f0d4-45c1-9f32-b6e8823e4b3c tempest-ServerRescueNegativeTestJSON-1201192591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7ebf0743-f0d4-45c1-9f32-b6e8823e4b3c tempest-ServerRescueNegativeTestJSON-1201192591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7ebf0743-f0d4-45c1-9f32-b6e8823e4b3c tempest-ServerRescueNegativeTestJSON-1201192591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:12 devstack sudo[87057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:09:12 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:13 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7ebf0743-f0d4-45c1-9f32-b6e8823e4b3c tempest-ServerRescueNegativeTestJSON-1201192591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 1.013s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:13 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-7ebf0743-f0d4-45c1-9f32-b6e8823e4b3c tempest-ServerRescueNegativeTestJSON-1201192591 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:09:13 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-7ebf0743-f0d4-45c1-9f32-b6e8823e4b3c tempest-ServerRescueNegativeTestJSON-1201192591 None] Deleted volume successfully. Apr 15 20:09:13 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7ebf0743-f0d4-45c1-9f32-b6e8823e4b3c tempest-ServerRescueNegativeTestJSON-1201192591 None] Lock "cinder-81e52920-a180-4319-8e70-e032e0ea35dc-delete_volume" released by "delete_volume" :: held 2.896s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Flow 'volume_create_manager' (629e9efd-906e-409d-8e58-b79fbcc1172b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad979f6a-1431-410e-8a7b-20a27b32dbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad979f6a-1431-410e-8a7b-20a27b32dbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1110187149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a180b5c-7687-4033-9141-c53d2c54624d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca4a47aa82224c19a6cb16dbdc62242e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:14Z,use_quota=True,user_id='be7f61fd334947628b1f8c110f9bac26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a879a2-4dfa-4516-a757-e3912f05de9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a879a2-4dfa-4516-a757-e3912f05de9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82eaf90-3056-4825-8fa8-40843cc67c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82eaf90-3056-4825-8fa8-40843cc67c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a180b5c-7687-4033-9141-c53d2c54624d', 'volume_name': 'volume-5a180b5c-7687-4033-9141-c53d2c54624d', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6431e8a-2379-4783-8586-b0a4727bc450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6431e8a-2379-4783-8586-b0a4727bc450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (722e7d84-b4f1-4cf2-95a6-010a5863ab65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:14 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Volume 5a180b5c-7687-4033-9141-c53d2c54624d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a180b5c-7687-4033-9141-c53d2c54624d', 'volume_size': 1} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1110187149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a180b5c-7687-4033-9141-c53d2c54624d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca4a47aa82224c19a6cb16dbdc62242e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:14Z,use_quota=True,user_id='be7f61fd334947628b1f8c110f9bac26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Creating volume 5a180b5c-7687-4033-9141-c53d2c54624d {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:09:14 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5a180b5c-7687-4033-9141-c53d2c54624d 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:14 devstack sudo[87090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5a180b5c-7687-4033-9141-c53d2c54624d 1073741824 Apr 15 20:09:14 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG dbcounter [-] [82989] Writing DB stats cinder:SELECT=78,cinder:INSERT=27,cinder:UPDATE=135,cinder:DELETE=8 {{(pid=82989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Flow 'volume_create_manager' (26e01f35-0887-431f-a181-a68cad9f5f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddebb54d-dac0-4b17-b93e-7c1fcb9fd097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddebb54d-dac0-4b17-b93e-7c1fcb9fd097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1162368034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=105e6968-1264-4f4b-91e0-ed612c586f67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43f05526ade47a7abb3c1b9713bec1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:15Z,use_quota=True,user_id='98a347b66262405789be5d7550f06ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07033ece-4225-4e30-b1af-424566aa394a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07033ece-4225-4e30-b1af-424566aa394a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6bb4596-0690-4a48-9687-2b0c34f95c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6bb4596-0690-4a48-9687-2b0c34f95c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '105e6968-1264-4f4b-91e0-ed612c586f67', 'volume_name': 'volume-105e6968-1264-4f4b-91e0-ed612c586f67', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89cb3b56-15f8-48c1-95f0-11e7ba372629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89cb3b56-15f8-48c1-95f0-11e7ba372629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90c225fe-d2a4-473c-82e7-ec4146aa6f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:14 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Volume 105e6968-1264-4f4b-91e0-ed612c586f67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-105e6968-1264-4f4b-91e0-ed612c586f67', 'volume_size': 1} Apr 15 20:09:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:15 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5a180b5c-7687-4033-9141-c53d2c54624d 1073741824" returned: 0 in 0.718s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5a180b5c-7687-4033-9141-c53d2c54624d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:15 devstack sudo[87098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5a180b5c-7687-4033-9141-c53d2c54624d Apr 15 20:09:15 devstack sudo[87098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:15 devstack sudo[87098]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5a180b5c-7687-4033-9141-c53d2c54624d" returned: 0 in 0.471s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:09:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.940s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1162368034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=105e6968-1264-4f4b-91e0-ed612c586f67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43f05526ade47a7abb3c1b9713bec1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:15Z,use_quota=True,user_id='98a347b66262405789be5d7550f06ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:09:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Creating volume 105e6968-1264-4f4b-91e0-ed612c586f67 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:09:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:09:15 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:09:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-105e6968-1264-4f4b-91e0-ed612c586f67 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (722e7d84-b4f1-4cf2-95a6-010a5863ab65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a180b5c-7687-4033-9141-c53d2c54624d', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f19450-aba2-4e7e-a65f-f7f76fea7ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:15 devstack sudo[87102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-105e6968-1264-4f4b-91e0-ed612c586f67 1073741824 Apr 15 20:09:15 devstack sudo[87102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:15 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Volume volume-5a180b5c-7687-4033-9141-c53d2c54624d (5a180b5c-7687-4033-9141-c53d2c54624d): created successfully Apr 15 20:09:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f19450-aba2-4e7e-a65f-f7f76fea7ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Flow 'volume_create_manager' (629e9efd-906e-409d-8e58-b79fbcc1172b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:15 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-38da0d7d-4031-4d50-b53e-ae7eed4c2550 tempest-VolumesNegativeTest-938944593 None] Created volume successfully. Apr 15 20:09:16 devstack sudo[87102]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-105e6968-1264-4f4b-91e0-ed612c586f67 1073741824" returned: 0 in 0.488s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-105e6968-1264-4f4b-91e0-ed612c586f67 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:16 devstack sudo[87107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-105e6968-1264-4f4b-91e0-ed612c586f67 Apr 15 20:09:16 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:16 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-105e6968-1264-4f4b-91e0-ed612c586f67" returned: 0 in 0.492s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:16 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:09:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:16 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90c225fe-d2a4-473c-82e7-ec4146aa6f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-105e6968-1264-4f4b-91e0-ed612c586f67', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:16 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32fb70e9-b5ca-43b7-a825-89d5067fda88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:16 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Volume volume-105e6968-1264-4f4b-91e0-ed612c586f67 (105e6968-1264-4f4b-91e0-ed612c586f67): created successfully Apr 15 20:09:16 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32fb70e9-b5ca-43b7-a825-89d5067fda88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:16 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Flow 'volume_create_manager' (26e01f35-0887-431f-a181-a68cad9f5f51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:16 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-36e11717-b897-4539-93a3-8411b31042e4 tempest-VolumesActionsTest-590745200 None] Created volume successfully. Apr 15 20:09:18 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b074cac2-50dd-44d2-a998-d343ceb9ece3 tempest-VolumesActionsTest-590745200 None] Acquiring lock "cinder-105e6968-1264-4f4b-91e0-ed612c586f67" by "attach_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:18 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b074cac2-50dd-44d2-a998-d343ceb9ece3 tempest-VolumesActionsTest-590745200 None] Lock "cinder-105e6968-1264-4f4b-91e0-ed612c586f67" acquired by "attach_volume" :: waited 0.015s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:18 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-b074cac2-50dd-44d2-a998-d343ceb9ece3 tempest-VolumesActionsTest-590745200 None] Attaching volume 105e6968-1264-4f4b-91e0-ed612c586f67 to instance b425ccf9-d97e-4a4d-b297-09bab6ba2369 at mountpoint /dev/vdb on host None. Apr 15 20:09:18 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-b074cac2-50dd-44d2-a998-d343ceb9ece3 tempest-VolumesActionsTest-590745200 None] Attach volume completed successfully. Apr 15 20:09:18 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b074cac2-50dd-44d2-a998-d343ceb9ece3 tempest-VolumesActionsTest-590745200 None] Lock "cinder-105e6968-1264-4f4b-91e0-ed612c586f67" released by "attach_volume" :: held 0.089s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:18 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-1b94564e-a441-42b3-8e16-8d8b8efee065 tempest-VolumesActionsTest-1982985722 None] Terminate volume connection completed successfully. Apr 15 20:09:19 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1b94564e-a441-42b3-8e16-8d8b8efee065 tempest-VolumesActionsTest-1982985722 None] Acquiring lock "cinder-105e6968-1264-4f4b-91e0-ed612c586f67-detach_volume" by "detach_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:19 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1b94564e-a441-42b3-8e16-8d8b8efee065 tempest-VolumesActionsTest-1982985722 None] Lock "cinder-105e6968-1264-4f4b-91e0-ed612c586f67-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:19 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-1b94564e-a441-42b3-8e16-8d8b8efee065 tempest-VolumesActionsTest-1982985722 None] Detaching volume 105e6968-1264-4f4b-91e0-ed612c586f67 from instance b425ccf9-d97e-4a4d-b297-09bab6ba2369. Apr 15 20:09:19 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-1b94564e-a441-42b3-8e16-8d8b8efee065 tempest-VolumesActionsTest-1982985722 None] Detach volume completed successfully. Apr 15 20:09:19 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1b94564e-a441-42b3-8e16-8d8b8efee065 tempest-VolumesActionsTest-1982985722 None] Lock "cinder-105e6968-1264-4f4b-91e0-ed612c586f67-detach_volume" released by "detach_volume" :: held 0.043s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-416a40f7-b04e-40d9-84f1-8f7065588baf tempest-VolumesActionsTest-590745200 None] Acquiring lock "cinder-105e6968-1264-4f4b-91e0-ed612c586f67-detach_volume" by "detach_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-416a40f7-b04e-40d9-84f1-8f7065588baf tempest-VolumesActionsTest-590745200 None] Lock "cinder-105e6968-1264-4f4b-91e0-ed612c586f67-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:20 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-416a40f7-b04e-40d9-84f1-8f7065588baf tempest-VolumesActionsTest-590745200 None] Volume detach called, but volume not attached. Apr 15 20:09:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-416a40f7-b04e-40d9-84f1-8f7065588baf tempest-VolumesActionsTest-590745200 None] Lock "cinder-105e6968-1264-4f4b-91e0-ed612c586f67-detach_volume" released by "detach_volume" :: held 0.013s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b613e8f0-ad9a-4c60-b4a9-eda67049410b tempest-VolumesActionsTest-590745200 None] Acquiring lock "cinder-105e6968-1264-4f4b-91e0-ed612c586f67-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b613e8f0-ad9a-4c60-b4a9-eda67049410b tempest-VolumesActionsTest-590745200 None] Lock "cinder-105e6968-1264-4f4b-91e0-ed612c586f67-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b613e8f0-ad9a-4c60-b4a9-eda67049410b tempest-VolumesActionsTest-590745200 None] Acquiring lock "cinder-quobyte-105e6968-1264-4f4b-91e0-ed612c586f67" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b613e8f0-ad9a-4c60-b4a9-eda67049410b tempest-VolumesActionsTest-590745200 None] Lock "cinder-quobyte-105e6968-1264-4f4b-91e0-ed612c586f67" acquired by "delete_volume" :: waited 0.033s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:20 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[8147bc34-cbfe-48f4-be7e-f34b91ea54fc]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:09:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b613e8f0-ad9a-4c60-b4a9-eda67049410b tempest-VolumesActionsTest-590745200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-105e6968-1264-4f4b-91e0-ed612c586f67 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:20 devstack sudo[87139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-105e6968-1264-4f4b-91e0-ed612c586f67 Apr 15 20:09:20 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:21 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b613e8f0-ad9a-4c60-b4a9-eda67049410b tempest-VolumesActionsTest-590745200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-105e6968-1264-4f4b-91e0-ed612c586f67" returned: 0 in 0.526s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b613e8f0-ad9a-4c60-b4a9-eda67049410b tempest-VolumesActionsTest-590745200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-105e6968-1264-4f4b-91e0-ed612c586f67 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:21 devstack sudo[87144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-105e6968-1264-4f4b-91e0-ed612c586f67 Apr 15 20:09:21 devstack sudo[87144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:22 devstack sudo[87144]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b613e8f0-ad9a-4c60-b4a9-eda67049410b tempest-VolumesActionsTest-590745200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-105e6968-1264-4f4b-91e0-ed612c586f67" returned: 0 in 0.688s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b613e8f0-ad9a-4c60-b4a9-eda67049410b tempest-VolumesActionsTest-590745200 None] Lock "cinder-quobyte-105e6968-1264-4f4b-91e0-ed612c586f67" released by "delete_volume" :: held 1.290s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:22 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-b613e8f0-ad9a-4c60-b4a9-eda67049410b tempest-VolumesActionsTest-590745200 None] Created reservations ['b1b21ba5-449e-4e7a-a80a-64831403a7ad', '7dadcf21-590e-4773-b2b3-753543392977', '3e64aab3-2eca-4641-8c9c-4396a58fd486', '3967993a-fae7-4300-941d-34326a2c799e'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:09:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b613e8f0-ad9a-4c60-b4a9-eda67049410b tempest-VolumesActionsTest-590745200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b613e8f0-ad9a-4c60-b4a9-eda67049410b tempest-VolumesActionsTest-590745200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:22 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b613e8f0-ad9a-4c60-b4a9-eda67049410b tempest-VolumesActionsTest-590745200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:22 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b613e8f0-ad9a-4c60-b4a9-eda67049410b tempest-VolumesActionsTest-590745200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b613e8f0-ad9a-4c60-b4a9-eda67049410b tempest-VolumesActionsTest-590745200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b613e8f0-ad9a-4c60-b4a9-eda67049410b tempest-VolumesActionsTest-590745200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:22 devstack sudo[87150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:09:22 devstack sudo[87150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:22 devstack sudo[87150]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b613e8f0-ad9a-4c60-b4a9-eda67049410b tempest-VolumesActionsTest-590745200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.552s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:22 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-b613e8f0-ad9a-4c60-b4a9-eda67049410b tempest-VolumesActionsTest-590745200 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:09:22 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-b613e8f0-ad9a-4c60-b4a9-eda67049410b tempest-VolumesActionsTest-590745200 None] Deleted volume successfully. Apr 15 20:09:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b613e8f0-ad9a-4c60-b4a9-eda67049410b tempest-VolumesActionsTest-590745200 None] Lock "cinder-105e6968-1264-4f4b-91e0-ed612c586f67-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:27 devstack cinder-volume[82989]: DEBUG oslo_service.periodic_task [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82989) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 20:09:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:27 devstack sudo[87229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:09:27 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:28 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.587s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:28 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:09:30 devstack cinder-volume[82989]: DEBUG dbcounter [-] [82989] Writing DB stats cinder:SELECT=94,cinder:INSERT=39,cinder:UPDATE=109,cinder:DELETE=10 {{(pid=82989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:09:30 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:09:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Flow 'volume_create_manager' (971e85f0-1723-4f43-9a6c-4dd2c6977226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a50716c-fec0-4368-bad1-24d7e51ba606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a50716c-fec0-4368-bad1-24d7e51ba606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1021337295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1394064-84e2-49a9-bda5-604e3691f05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43f05526ade47a7abb3c1b9713bec1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:31Z,use_quota=True,user_id='98a347b66262405789be5d7550f06ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47460f1e-769a-4754-a767-beb3091b3a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47460f1e-769a-4754-a767-beb3091b3a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f56eb15-2fff-4d7d-99fa-00c202606df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f56eb15-2fff-4d7d-99fa-00c202606df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1394064-84e2-49a9-bda5-604e3691f05c', 'volume_name': 'volume-f1394064-84e2-49a9-bda5-604e3691f05c', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012f348f-da09-4844-b619-8639b3760060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012f348f-da09-4844-b619-8639b3760060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524fa6a2-b327-4514-aaa6-835b9254e0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:30 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Volume f1394064-84e2-49a9-bda5-604e3691f05c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1394064-84e2-49a9-bda5-604e3691f05c', 'volume_size': 1} Apr 15 20:09:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1021337295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1394064-84e2-49a9-bda5-604e3691f05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43f05526ade47a7abb3c1b9713bec1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:31Z,use_quota=True,user_id='98a347b66262405789be5d7550f06ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:09:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Creating volume f1394064-84e2-49a9-bda5-604e3691f05c {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:09:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:09:30 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:09:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1394064-84e2-49a9-bda5-604e3691f05c 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:30 devstack sudo[87236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1394064-84e2-49a9-bda5-604e3691f05c 1073741824 Apr 15 20:09:30 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Flow 'volume_create_manager' (a37dcf5a-8d22-43f6-8853-eed380992299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b776e4-7ee3-4b59-95c4-ef38db73b2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b776e4-7ee3-4b59-95c4-ef38db73b2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1160789254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3257fbc-d539-428a-a08c-c36bbf4a6aab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0b0d6cead924ebd99a10b5e74259ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:31Z,use_quota=True,user_id='1a08b6d0029b421a837b64208696aa1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c1f37de-a358-4672-8be4-78b214c87f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c1f37de-a358-4672-8be4-78b214c87f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d56092-4990-42a3-b47a-733a2984ecf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d56092-4990-42a3-b47a-733a2984ecf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3257fbc-d539-428a-a08c-c36bbf4a6aab', 'volume_name': 'volume-f3257fbc-d539-428a-a08c-c36bbf4a6aab', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf74622-bcf0-4d0f-83bb-f65c2cebe609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf74622-bcf0-4d0f-83bb-f65c2cebe609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2826d913-a917-4c05-971f-7ecf33217a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:31 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Volume f3257fbc-d539-428a-a08c-c36bbf4a6aab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3257fbc-d539-428a-a08c-c36bbf4a6aab', 'volume_size': 1} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:31 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1394064-84e2-49a9-bda5-604e3691f05c 1073741824" returned: 0 in 0.725s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1394064-84e2-49a9-bda5-604e3691f05c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:31 devstack sudo[87248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1394064-84e2-49a9-bda5-604e3691f05c Apr 15 20:09:31 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:31 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1394064-84e2-49a9-bda5-604e3691f05c" returned: 0 in 0.400s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.626s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1160789254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3257fbc-d539-428a-a08c-c36bbf4a6aab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0b0d6cead924ebd99a10b5e74259ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:31Z,use_quota=True,user_id='1a08b6d0029b421a837b64208696aa1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Creating volume f3257fbc-d539-428a-a08c-c36bbf4a6aab {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:09:31 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3257fbc-d539-428a-a08c-c36bbf4a6aab 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524fa6a2-b327-4514-aaa6-835b9254e0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1394064-84e2-49a9-bda5-604e3691f05c', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f6b0d5-245b-4e8a-9820-ec0f091a55c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:31 devstack sudo[87251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3257fbc-d539-428a-a08c-c36bbf4a6aab 1073741824 Apr 15 20:09:31 devstack sudo[87251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:31 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Volume volume-f1394064-84e2-49a9-bda5-604e3691f05c (f1394064-84e2-49a9-bda5-604e3691f05c): created successfully Apr 15 20:09:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f6b0d5-245b-4e8a-9820-ec0f091a55c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:32 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Flow 'volume_create_manager' (971e85f0-1723-4f43-9a6c-4dd2c6977226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:32 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-dbc10d3f-a560-4b9a-a5f0-af12194af95d tempest-VolumesActionsTest-590745200 None] Created volume successfully. Apr 15 20:09:32 devstack sudo[87251]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3257fbc-d539-428a-a08c-c36bbf4a6aab 1073741824" returned: 0 in 0.643s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3257fbc-d539-428a-a08c-c36bbf4a6aab {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:32 devstack sudo[87286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3257fbc-d539-428a-a08c-c36bbf4a6aab Apr 15 20:09:32 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2b8b4562-942f-4560-8128-c47b0db5fc29 tempest-VolumesActionsTest-1982985722 None] Acquiring lock "cinder-f1394064-84e2-49a9-bda5-604e3691f05c-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2b8b4562-942f-4560-8128-c47b0db5fc29 tempest-VolumesActionsTest-1982985722 None] Lock "cinder-f1394064-84e2-49a9-bda5-604e3691f05c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2b8b4562-942f-4560-8128-c47b0db5fc29 tempest-VolumesActionsTest-1982985722 None] Acquiring lock "cinder-quobyte-f1394064-84e2-49a9-bda5-604e3691f05c" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2b8b4562-942f-4560-8128-c47b0db5fc29 tempest-VolumesActionsTest-1982985722 None] Lock "cinder-quobyte-f1394064-84e2-49a9-bda5-604e3691f05c" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:32 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[57061b6d-2ee8-4b83-80ce-631f3b782c98]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:09:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2b8b4562-942f-4560-8128-c47b0db5fc29 tempest-VolumesActionsTest-1982985722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1394064-84e2-49a9-bda5-604e3691f05c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:33 devstack sudo[87288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1394064-84e2-49a9-bda5-604e3691f05c Apr 15 20:09:33 devstack sudo[87288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:33 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3257fbc-d539-428a-a08c-c36bbf4a6aab" returned: 0 in 0.474s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:33 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:09:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:33 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2826d913-a917-4c05-971f-7ecf33217a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3257fbc-d539-428a-a08c-c36bbf4a6aab', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:33 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1608b7-c046-43b0-9540-9662cc1aa0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:33 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Volume volume-f3257fbc-d539-428a-a08c-c36bbf4a6aab (f3257fbc-d539-428a-a08c-c36bbf4a6aab): created successfully Apr 15 20:09:33 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1608b7-c046-43b0-9540-9662cc1aa0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:33 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Flow 'volume_create_manager' (a37dcf5a-8d22-43f6-8853-eed380992299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:33 devstack cinder-volume[82989]: INFO cinder.volume.manager [req-08d0c51c-7214-4420-871e-d97b2c104ad7 req-5a9596b6-03f2-4001-9583-7c7bb27fcf6d tempest-VolumesGetTestJSON-133800954 None] Created volume successfully. Apr 15 20:09:33 devstack sudo[87288]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2b8b4562-942f-4560-8128-c47b0db5fc29 tempest-VolumesActionsTest-1982985722 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1394064-84e2-49a9-bda5-604e3691f05c" returned: 0 in 0.522s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2b8b4562-942f-4560-8128-c47b0db5fc29 tempest-VolumesActionsTest-1982985722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1394064-84e2-49a9-bda5-604e3691f05c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:33 devstack sudo[87295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1394064-84e2-49a9-bda5-604e3691f05c Apr 15 20:09:33 devstack sudo[87295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-9ee1ccd2-1437-4eca-925a-37f0e987f31b req-15265657-4302-4747-bfe4-e914635d56e8 tempest-VolumesGetTestJSON-133800954 None] Acquiring lock "cinder-f3257fbc-d539-428a-a08c-c36bbf4a6aab-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-9ee1ccd2-1437-4eca-925a-37f0e987f31b req-15265657-4302-4747-bfe4-e914635d56e8 tempest-VolumesGetTestJSON-133800954 None] Lock "cinder-f3257fbc-d539-428a-a08c-c36bbf4a6aab-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-9ee1ccd2-1437-4eca-925a-37f0e987f31b req-15265657-4302-4747-bfe4-e914635d56e8 tempest-VolumesGetTestJSON-133800954 None] Acquiring lock "cinder-quobyte-f3257fbc-d539-428a-a08c-c36bbf4a6aab" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-9ee1ccd2-1437-4eca-925a-37f0e987f31b req-15265657-4302-4747-bfe4-e914635d56e8 tempest-VolumesGetTestJSON-133800954 None] Lock "cinder-quobyte-f3257fbc-d539-428a-a08c-c36bbf4a6aab" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:33 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f779b5-8a11-435f-9a65-e604b89698ae]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:09:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-9ee1ccd2-1437-4eca-925a-37f0e987f31b req-15265657-4302-4747-bfe4-e914635d56e8 tempest-VolumesGetTestJSON-133800954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3257fbc-d539-428a-a08c-c36bbf4a6aab {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:33 devstack sudo[87297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3257fbc-d539-428a-a08c-c36bbf4a6aab Apr 15 20:09:33 devstack sudo[87297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:33 devstack sudo[87295]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2b8b4562-942f-4560-8128-c47b0db5fc29 tempest-VolumesActionsTest-1982985722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1394064-84e2-49a9-bda5-604e3691f05c" returned: 0 in 0.464s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2b8b4562-942f-4560-8128-c47b0db5fc29 tempest-VolumesActionsTest-1982985722 None] Lock "cinder-quobyte-f1394064-84e2-49a9-bda5-604e3691f05c" released by "delete_volume" :: held 1.019s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:34 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-2b8b4562-942f-4560-8128-c47b0db5fc29 tempest-VolumesActionsTest-1982985722 None] Created reservations ['52ee1451-f0a1-4bf2-a02d-d710e9db58ad', '2643768f-57be-48ad-a937-586ab406ca36', '89bccbc3-b080-4e55-aabd-bf3c6ac750e5', 'be9eb1d6-1e60-4d68-b396-f730a4175723'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:09:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2b8b4562-942f-4560-8128-c47b0db5fc29 tempest-VolumesActionsTest-1982985722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2b8b4562-942f-4560-8128-c47b0db5fc29 tempest-VolumesActionsTest-1982985722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2b8b4562-942f-4560-8128-c47b0db5fc29 tempest-VolumesActionsTest-1982985722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2b8b4562-942f-4560-8128-c47b0db5fc29 tempest-VolumesActionsTest-1982985722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2b8b4562-942f-4560-8128-c47b0db5fc29 tempest-VolumesActionsTest-1982985722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2b8b4562-942f-4560-8128-c47b0db5fc29 tempest-VolumesActionsTest-1982985722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:34 devstack sudo[87302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:09:34 devstack sudo[87302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:34 devstack sudo[87297]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-9ee1ccd2-1437-4eca-925a-37f0e987f31b req-15265657-4302-4747-bfe4-e914635d56e8 tempest-VolumesGetTestJSON-133800954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3257fbc-d539-428a-a08c-c36bbf4a6aab" returned: 0 in 0.533s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-9ee1ccd2-1437-4eca-925a-37f0e987f31b req-15265657-4302-4747-bfe4-e914635d56e8 tempest-VolumesGetTestJSON-133800954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3257fbc-d539-428a-a08c-c36bbf4a6aab {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:34 devstack sudo[87306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3257fbc-d539-428a-a08c-c36bbf4a6aab Apr 15 20:09:34 devstack sudo[87306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:34 devstack sudo[87302]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2b8b4562-942f-4560-8128-c47b0db5fc29 tempest-VolumesActionsTest-1982985722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.450s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:34 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-2b8b4562-942f-4560-8128-c47b0db5fc29 tempest-VolumesActionsTest-1982985722 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:09:34 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-2b8b4562-942f-4560-8128-c47b0db5fc29 tempest-VolumesActionsTest-1982985722 None] Deleted volume successfully. Apr 15 20:09:34 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2b8b4562-942f-4560-8128-c47b0db5fc29 tempest-VolumesActionsTest-1982985722 None] Lock "cinder-f1394064-84e2-49a9-bda5-604e3691f05c-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:34 devstack sudo[87306]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-9ee1ccd2-1437-4eca-925a-37f0e987f31b req-15265657-4302-4747-bfe4-e914635d56e8 tempest-VolumesGetTestJSON-133800954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f3257fbc-d539-428a-a08c-c36bbf4a6aab" returned: 0 in 0.429s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:34 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-9ee1ccd2-1437-4eca-925a-37f0e987f31b req-15265657-4302-4747-bfe4-e914635d56e8 tempest-VolumesGetTestJSON-133800954 None] Lock "cinder-quobyte-f3257fbc-d539-428a-a08c-c36bbf4a6aab" released by "delete_volume" :: held 0.998s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:34 devstack cinder-volume[82989]: DEBUG cinder.quota [req-9ee1ccd2-1437-4eca-925a-37f0e987f31b req-15265657-4302-4747-bfe4-e914635d56e8 tempest-VolumesGetTestJSON-133800954 None] Created reservations ['df94fbe4-86fc-48b4-8b67-f9feb6fd3c26', '46257587-7532-48e9-aa8e-c772bca1db64', '1e1eee86-cde2-4c29-b9bb-3283746b0f38', '393b71a5-e6b8-4a61-a291-820a02953baa'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:09:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-9ee1ccd2-1437-4eca-925a-37f0e987f31b req-15265657-4302-4747-bfe4-e914635d56e8 tempest-VolumesGetTestJSON-133800954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-9ee1ccd2-1437-4eca-925a-37f0e987f31b req-15265657-4302-4747-bfe4-e914635d56e8 tempest-VolumesGetTestJSON-133800954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-9ee1ccd2-1437-4eca-925a-37f0e987f31b req-15265657-4302-4747-bfe4-e914635d56e8 tempest-VolumesGetTestJSON-133800954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [req-9ee1ccd2-1437-4eca-925a-37f0e987f31b req-15265657-4302-4747-bfe4-e914635d56e8 tempest-VolumesGetTestJSON-133800954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [req-9ee1ccd2-1437-4eca-925a-37f0e987f31b req-15265657-4302-4747-bfe4-e914635d56e8 tempest-VolumesGetTestJSON-133800954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-9ee1ccd2-1437-4eca-925a-37f0e987f31b req-15265657-4302-4747-bfe4-e914635d56e8 tempest-VolumesGetTestJSON-133800954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:34 devstack sudo[87310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:09:34 devstack sudo[87310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:35 devstack sudo[87310]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [req-9ee1ccd2-1437-4eca-925a-37f0e987f31b req-15265657-4302-4747-bfe4-e914635d56e8 tempest-VolumesGetTestJSON-133800954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.492s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG cinder.manager [req-9ee1ccd2-1437-4eca-925a-37f0e987f31b req-15265657-4302-4747-bfe4-e914635d56e8 tempest-VolumesGetTestJSON-133800954 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:09:35 devstack cinder-volume[82989]: INFO cinder.volume.manager [req-9ee1ccd2-1437-4eca-925a-37f0e987f31b req-15265657-4302-4747-bfe4-e914635d56e8 tempest-VolumesGetTestJSON-133800954 None] Deleted volume successfully. Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG cinder.coordination [req-9ee1ccd2-1437-4eca-925a-37f0e987f31b req-15265657-4302-4747-bfe4-e914635d56e8 tempest-VolumesGetTestJSON-133800954 None] Lock "cinder-f3257fbc-d539-428a-a08c-c36bbf4a6aab-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Flow 'volume_create_manager' (c07ccbf3-9c68-4980-b23b-f1e71ec48614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1dbe0a8-2baf-4807-a5f9-96051cddfa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1dbe0a8-2baf-4807-a5f9-96051cddfa8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1785533830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8566d93f-4858-4ebd-ba75-51c7de43099a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43f05526ade47a7abb3c1b9713bec1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:35Z,use_quota=True,user_id='98a347b66262405789be5d7550f06ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c648e4d-a23c-4e2c-97f1-dbd6e1cacf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c648e4d-a23c-4e2c-97f1-dbd6e1cacf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df71bd5-abe4-47be-ac89-c8e546e643f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df71bd5-abe4-47be-ac89-c8e546e643f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8566d93f-4858-4ebd-ba75-51c7de43099a', 'volume_name': 'volume-8566d93f-4858-4ebd-ba75-51c7de43099a', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8205b736-1dd5-4e6a-b442-f42fe4b85ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8205b736-1dd5-4e6a-b442-f42fe4b85ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9d1e93-40b1-424c-b36c-fe9968d43646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:35 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Volume 8566d93f-4858-4ebd-ba75-51c7de43099a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8566d93f-4858-4ebd-ba75-51c7de43099a', 'volume_size': 1} Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1785533830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8566d93f-4858-4ebd-ba75-51c7de43099a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43f05526ade47a7abb3c1b9713bec1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:35Z,use_quota=True,user_id='98a347b66262405789be5d7550f06ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Creating volume 8566d93f-4858-4ebd-ba75-51c7de43099a {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:09:35 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:09:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8566d93f-4858-4ebd-ba75-51c7de43099a 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:35 devstack sudo[87313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8566d93f-4858-4ebd-ba75-51c7de43099a 1073741824 Apr 15 20:09:35 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:36 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8566d93f-4858-4ebd-ba75-51c7de43099a 1073741824" returned: 0 in 0.539s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8566d93f-4858-4ebd-ba75-51c7de43099a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:36 devstack sudo[87318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8566d93f-4858-4ebd-ba75-51c7de43099a Apr 15 20:09:36 devstack sudo[87318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:36 devstack sudo[87318]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8566d93f-4858-4ebd-ba75-51c7de43099a" returned: 0 in 0.493s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:36 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:09:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:36 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9d1e93-40b1-424c-b36c-fe9968d43646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8566d93f-4858-4ebd-ba75-51c7de43099a', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:36 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487b2f2d-7bdf-4376-81a9-fa979de5c0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:36 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Volume volume-8566d93f-4858-4ebd-ba75-51c7de43099a (8566d93f-4858-4ebd-ba75-51c7de43099a): created successfully Apr 15 20:09:36 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487b2f2d-7bdf-4376-81a9-fa979de5c0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:36 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Flow 'volume_create_manager' (c07ccbf3-9c68-4980-b23b-f1e71ec48614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:36 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-0bd4abe6-7581-4711-9e21-a4d4f1105fc6 tempest-VolumesActionsTest-590745200 None] Created volume successfully. Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Flow 'volume_create_manager' (ff7c5ed1-349e-472e-a4ce-c9065e8476ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ede589c-8f14-4411-be14-05924bb1188a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ede589c-8f14-4411-be14-05924bb1188a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1388801243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='79423aa29d1e4f7d88cad630ce8e825a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:37Z,use_quota=True,user_id='aca568d733284d068db95a8b37197f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6bc976-b633-4fc9-b086-1e700c6c38ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6bc976-b633-4fc9-b086-1e700c6c38ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74e1827-e5ff-42e1-a03d-ad27c63dd529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74e1827-e5ff-42e1-a03d-ad27c63dd529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2', 'volume_name': 'volume-6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab50784-867e-4eae-b5a6-904ead28b682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab50784-867e-4eae-b5a6-904ead28b682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52258e99-80e3-4d8f-aa61-7066c85077c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:37 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Volume 6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2', 'volume_size': 1} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1388801243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='79423aa29d1e4f7d88cad630ce8e825a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:37Z,use_quota=True,user_id='aca568d733284d068db95a8b37197f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Creating volume 6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:09:37 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:37 devstack sudo[87321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2 1073741824 Apr 15 20:09:37 devstack sudo[87321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a12ca595-5c6d-45a4-a50a-0700b2902bbb tempest-VolumesActionsTest-1982985722 None] Acquiring lock "cinder-8566d93f-4858-4ebd-ba75-51c7de43099a-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a12ca595-5c6d-45a4-a50a-0700b2902bbb tempest-VolumesActionsTest-1982985722 None] Lock "cinder-8566d93f-4858-4ebd-ba75-51c7de43099a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:37 devstack sudo[87321]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2 1073741824" returned: 0 in 0.526s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a12ca595-5c6d-45a4-a50a-0700b2902bbb tempest-VolumesActionsTest-1982985722 None] Acquiring lock "cinder-quobyte-8566d93f-4858-4ebd-ba75-51c7de43099a" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a12ca595-5c6d-45a4-a50a-0700b2902bbb tempest-VolumesActionsTest-1982985722 None] Lock "cinder-quobyte-8566d93f-4858-4ebd-ba75-51c7de43099a" acquired by "delete_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8e864c-defb-4958-bb21-5ec54d92c68c]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a12ca595-5c6d-45a4-a50a-0700b2902bbb tempest-VolumesActionsTest-1982985722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8566d93f-4858-4ebd-ba75-51c7de43099a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:37 devstack sudo[87327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2 Apr 15 20:09:37 devstack sudo[87327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:37 devstack sudo[87326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8566d93f-4858-4ebd-ba75-51c7de43099a Apr 15 20:09:37 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:38 devstack sudo[87327]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2" returned: 0 in 0.446s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:38 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:09:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:38 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52258e99-80e3-4d8f-aa61-7066c85077c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:38 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25bdd87c-2035-4de3-98f0-35609447f590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:38 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Volume volume-6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2 (6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2): created successfully Apr 15 20:09:38 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25bdd87c-2035-4de3-98f0-35609447f590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:38 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Flow 'volume_create_manager' (ff7c5ed1-349e-472e-a4ce-c9065e8476ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:38 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a12ca595-5c6d-45a4-a50a-0700b2902bbb tempest-VolumesActionsTest-1982985722 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8566d93f-4858-4ebd-ba75-51c7de43099a" returned: 0 in 0.496s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a12ca595-5c6d-45a4-a50a-0700b2902bbb tempest-VolumesActionsTest-1982985722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8566d93f-4858-4ebd-ba75-51c7de43099a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:38 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-8d24441a-e475-488d-b95c-0336a0731014 tempest-VolumesTestJSON-1096091165 None] Created volume successfully. Apr 15 20:09:38 devstack sudo[87334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8566d93f-4858-4ebd-ba75-51c7de43099a Apr 15 20:09:38 devstack sudo[87334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:38 devstack sudo[87334]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a12ca595-5c6d-45a4-a50a-0700b2902bbb tempest-VolumesActionsTest-1982985722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8566d93f-4858-4ebd-ba75-51c7de43099a" returned: 0 in 0.483s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:38 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a12ca595-5c6d-45a4-a50a-0700b2902bbb tempest-VolumesActionsTest-1982985722 None] Lock "cinder-quobyte-8566d93f-4858-4ebd-ba75-51c7de43099a" released by "delete_volume" :: held 1.002s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:38 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-a12ca595-5c6d-45a4-a50a-0700b2902bbb tempest-VolumesActionsTest-1982985722 None] Created reservations ['12537425-e349-4aac-bb64-5048f5073f9b', '162e5c1c-9f76-4b7f-9c83-5d9f025b8e79', 'c741fee5-46ca-4214-aad9-5be13982271e', 'b8aaa33d-abf7-4494-8fa0-3b6dac7542dd'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:09:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a12ca595-5c6d-45a4-a50a-0700b2902bbb tempest-VolumesActionsTest-1982985722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a12ca595-5c6d-45a4-a50a-0700b2902bbb tempest-VolumesActionsTest-1982985722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:38 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-a12ca595-5c6d-45a4-a50a-0700b2902bbb tempest-VolumesActionsTest-1982985722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:38 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-a12ca595-5c6d-45a4-a50a-0700b2902bbb tempest-VolumesActionsTest-1982985722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a12ca595-5c6d-45a4-a50a-0700b2902bbb tempest-VolumesActionsTest-1982985722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a12ca595-5c6d-45a4-a50a-0700b2902bbb tempest-VolumesActionsTest-1982985722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:38 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:09:38 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:39 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a12ca595-5c6d-45a4-a50a-0700b2902bbb tempest-VolumesActionsTest-1982985722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.503s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-a12ca595-5c6d-45a4-a50a-0700b2902bbb tempest-VolumesActionsTest-1982985722 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:09:39 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-a12ca595-5c6d-45a4-a50a-0700b2902bbb tempest-VolumesActionsTest-1982985722 None] Deleted volume successfully. Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a12ca595-5c6d-45a4-a50a-0700b2902bbb tempest-VolumesActionsTest-1982985722 None] Lock "cinder-8566d93f-4858-4ebd-ba75-51c7de43099a-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Flow 'volume_create_manager' (23f1f359-ffb2-4462-8b53-0b6a755a397f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a2c74b-ec9e-4719-9d10-b11e68f7e443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a2c74b-ec9e-4719-9d10-b11e68f7e443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-24734326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80450c9d-9d16-486b-ad4f-56c7b17aa559,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='79423aa29d1e4f7d88cad630ce8e825a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:39Z,use_quota=True,user_id='aca568d733284d068db95a8b37197f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d40e200-d53a-4ed3-9062-f5db476cae04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d40e200-d53a-4ed3-9062-f5db476cae04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d8cd01-e82f-44da-adea-12f042f063dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d8cd01-e82f-44da-adea-12f042f063dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80450c9d-9d16-486b-ad4f-56c7b17aa559', 'volume_name': 'volume-80450c9d-9d16-486b-ad4f-56c7b17aa559', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9a441e-79a2-4778-b328-5b1e2278dd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9a441e-79a2-4778-b328-5b1e2278dd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8dc7f1f-36b6-41c5-81c1-77e63269876e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:39 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Volume 80450c9d-9d16-486b-ad4f-56c7b17aa559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80450c9d-9d16-486b-ad4f-56c7b17aa559', 'volume_size': 1} Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-24734326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80450c9d-9d16-486b-ad4f-56c7b17aa559,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='79423aa29d1e4f7d88cad630ce8e825a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:39Z,use_quota=True,user_id='aca568d733284d068db95a8b37197f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Creating volume 80450c9d-9d16-486b-ad4f-56c7b17aa559 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:09:39 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:09:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-80450c9d-9d16-486b-ad4f-56c7b17aa559 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:39 devstack sudo[87340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-80450c9d-9d16-486b-ad4f-56c7b17aa559 1073741824 Apr 15 20:09:39 devstack sudo[87340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Flow 'volume_create_manager' (883f02a7-6b8c-4f6e-93b3-e448b6b19e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (847dcba6-1452-41b8-9ad0-56ed9b537d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (847dcba6-1452-41b8-9ad0-56ed9b537d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-287425799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7411715-f948-406c-bd85-0849440d86ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43f05526ade47a7abb3c1b9713bec1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:40Z,use_quota=True,user_id='98a347b66262405789be5d7550f06ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59875dc-bef2-422e-b0a8-7b0042f3f9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59875dc-bef2-422e-b0a8-7b0042f3f9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:40 devstack sudo[87340]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6e22f05-6258-447e-bc22-b28580fb31e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6e22f05-6258-447e-bc22-b28580fb31e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7411715-f948-406c-bd85-0849440d86ea', 'volume_name': 'volume-d7411715-f948-406c-bd85-0849440d86ea', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caa467e3-a295-4587-9a49-7e9569ca4b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caa467e3-a295-4587-9a49-7e9569ca4b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48fc5e8c-6b3e-4ae9-b961-37d3d0d9a8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:40 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Volume d7411715-f948-406c-bd85-0849440d86ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7411715-f948-406c-bd85-0849440d86ea', 'volume_size': 1} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-80450c9d-9d16-486b-ad4f-56c7b17aa559 1073741824" returned: 0 in 0.630s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-80450c9d-9d16-486b-ad4f-56c7b17aa559 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:40 devstack sudo[87347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-80450c9d-9d16-486b-ad4f-56c7b17aa559 Apr 15 20:09:40 devstack sudo[87347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:40 devstack sudo[87347]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-80450c9d-9d16-486b-ad4f-56c7b17aa559" returned: 0 in 0.432s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.459s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-287425799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7411715-f948-406c-bd85-0849440d86ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43f05526ade47a7abb3c1b9713bec1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:40Z,use_quota=True,user_id='98a347b66262405789be5d7550f06ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Creating volume d7411715-f948-406c-bd85-0849440d86ea {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:09:40 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d7411715-f948-406c-bd85-0849440d86ea 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8dc7f1f-36b6-41c5-81c1-77e63269876e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80450c9d-9d16-486b-ad4f-56c7b17aa559', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:40 devstack sudo[87350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d7411715-f948-406c-bd85-0849440d86ea 1073741824 Apr 15 20:09:40 devstack sudo[87350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4927098-0ea3-49d1-99da-e5ee37fc7b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:40 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Volume volume-80450c9d-9d16-486b-ad4f-56c7b17aa559 (80450c9d-9d16-486b-ad4f-56c7b17aa559): created successfully Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4927098-0ea3-49d1-99da-e5ee37fc7b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Flow 'volume_create_manager' (23f1f359-ffb2-4462-8b53-0b6a755a397f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:40 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-80a79b80-8528-46d9-9d70-0ec4734e1eab tempest-VolumesTestJSON-1096091165 None] Created volume successfully. Apr 15 20:09:41 devstack sudo[87350]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d7411715-f948-406c-bd85-0849440d86ea 1073741824" returned: 0 in 0.523s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d7411715-f948-406c-bd85-0849440d86ea {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:41 devstack sudo[87355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d7411715-f948-406c-bd85-0849440d86ea Apr 15 20:09:41 devstack sudo[87355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:41 devstack sudo[87355]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d7411715-f948-406c-bd85-0849440d86ea" returned: 0 in 0.474s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:41 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:09:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48fc5e8c-6b3e-4ae9-b961-37d3d0d9a8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7411715-f948-406c-bd85-0849440d86ea', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e375a7c9-fdf1-4085-ab25-e31463a1899f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:41 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Volume volume-d7411715-f948-406c-bd85-0849440d86ea (d7411715-f948-406c-bd85-0849440d86ea): created successfully Apr 15 20:09:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e375a7c9-fdf1-4085-ab25-e31463a1899f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Flow 'volume_create_manager' (883f02a7-6b8c-4f6e-93b3-e448b6b19e33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:41 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-c105f24e-667a-44d3-9c04-2d79dd164ea0 tempest-VolumesActionsTest-590745200 None] Created volume successfully. Apr 15 20:09:41 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Flow 'volume_create_manager' (90928ff1-7fc3-4cdb-afb6-63eceb89d27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8dbd816-f94f-413b-bda9-cf52e147e25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8dbd816-f94f-413b-bda9-cf52e147e25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1977869570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b01bd3-cead-4e72-acde-638a6a4b5a96,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='79423aa29d1e4f7d88cad630ce8e825a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:42Z,use_quota=True,user_id='aca568d733284d068db95a8b37197f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e492f8-6e98-44a1-b237-dc15673846ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e492f8-6e98-44a1-b237-dc15673846ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ac408e-7695-4387-8fb3-b0a53e5b32ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ac408e-7695-4387-8fb3-b0a53e5b32ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8b01bd3-cead-4e72-acde-638a6a4b5a96', 'volume_name': 'volume-a8b01bd3-cead-4e72-acde-638a6a4b5a96', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc1c719-c58e-4250-ab4a-94d82131f248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc1c719-c58e-4250-ab4a-94d82131f248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f470d2-8be3-4321-8f78-d34090898ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:42 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Volume a8b01bd3-cead-4e72-acde-638a6a4b5a96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8b01bd3-cead-4e72-acde-638a6a4b5a96', 'volume_size': 1} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1977869570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b01bd3-cead-4e72-acde-638a6a4b5a96,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='79423aa29d1e4f7d88cad630ce8e825a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:42Z,use_quota=True,user_id='aca568d733284d068db95a8b37197f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Creating volume a8b01bd3-cead-4e72-acde-638a6a4b5a96 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:09:42 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a8b01bd3-cead-4e72-acde-638a6a4b5a96 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:42 devstack sudo[87358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a8b01bd3-cead-4e72-acde-638a6a4b5a96 1073741824 Apr 15 20:09:42 devstack sudo[87358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a45b7f3f-80f5-4df0-8b04-edf0b717b249 tempest-VolumesActionsTest-1982985722 None] Acquiring lock "cinder-d7411715-f948-406c-bd85-0849440d86ea-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a45b7f3f-80f5-4df0-8b04-edf0b717b249 tempest-VolumesActionsTest-1982985722 None] Lock "cinder-d7411715-f948-406c-bd85-0849440d86ea-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a45b7f3f-80f5-4df0-8b04-edf0b717b249 tempest-VolumesActionsTest-1982985722 None] Acquiring lock "cinder-quobyte-d7411715-f948-406c-bd85-0849440d86ea" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a45b7f3f-80f5-4df0-8b04-edf0b717b249 tempest-VolumesActionsTest-1982985722 None] Lock "cinder-quobyte-d7411715-f948-406c-bd85-0849440d86ea" acquired by "delete_volume" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75b906f-772f-43d3-87bc-83983ae6056e]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a45b7f3f-80f5-4df0-8b04-edf0b717b249 tempest-VolumesActionsTest-1982985722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d7411715-f948-406c-bd85-0849440d86ea {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:42 devstack sudo[87361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d7411715-f948-406c-bd85-0849440d86ea Apr 15 20:09:42 devstack sudo[87361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a50adb63-c4ed-42e8-bac7-71f6fa6df0b0 tempest-VolumesNegativeTest-938944593 None] Acquiring lock "cinder-5a180b5c-7687-4033-9141-c53d2c54624d-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a50adb63-c4ed-42e8-bac7-71f6fa6df0b0 tempest-VolumesNegativeTest-938944593 None] Lock "cinder-5a180b5c-7687-4033-9141-c53d2c54624d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a50adb63-c4ed-42e8-bac7-71f6fa6df0b0 tempest-VolumesNegativeTest-938944593 None] Acquiring lock "cinder-quobyte-5a180b5c-7687-4033-9141-c53d2c54624d" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a50adb63-c4ed-42e8-bac7-71f6fa6df0b0 tempest-VolumesNegativeTest-938944593 None] Lock "cinder-quobyte-5a180b5c-7687-4033-9141-c53d2c54624d" acquired by "delete_volume" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:42 devstack sudo[87358]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a8b01bd3-cead-4e72-acde-638a6a4b5a96 1073741824" returned: 0 in 0.577s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ef37bc-9e19-430a-a139-287a434da0de]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a50adb63-c4ed-42e8-bac7-71f6fa6df0b0 tempest-VolumesNegativeTest-938944593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5a180b5c-7687-4033-9141-c53d2c54624d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a8b01bd3-cead-4e72-acde-638a6a4b5a96 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:42 devstack sudo[87367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a8b01bd3-cead-4e72-acde-638a6a4b5a96 Apr 15 20:09:42 devstack sudo[87367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:42 devstack sudo[87366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5a180b5c-7687-4033-9141-c53d2c54624d Apr 15 20:09:42 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:42 devstack sudo[87361]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a45b7f3f-80f5-4df0-8b04-edf0b717b249 tempest-VolumesActionsTest-1982985722 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d7411715-f948-406c-bd85-0849440d86ea" returned: 0 in 0.564s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a45b7f3f-80f5-4df0-8b04-edf0b717b249 tempest-VolumesActionsTest-1982985722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d7411715-f948-406c-bd85-0849440d86ea {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:43 devstack sudo[87373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d7411715-f948-406c-bd85-0849440d86ea Apr 15 20:09:43 devstack sudo[87373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:43 devstack sudo[87367]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a8b01bd3-cead-4e72-acde-638a6a4b5a96" returned: 0 in 0.438s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f470d2-8be3-4321-8f78-d34090898ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8b01bd3-cead-4e72-acde-638a6a4b5a96', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac99b4a0-4c86-4d22-a6b2-4baa334b3056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:43 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Volume volume-a8b01bd3-cead-4e72-acde-638a6a4b5a96 (a8b01bd3-cead-4e72-acde-638a6a4b5a96): created successfully Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac99b4a0-4c86-4d22-a6b2-4baa334b3056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:43 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Flow 'volume_create_manager' (90928ff1-7fc3-4cdb-afb6-63eceb89d27f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a50adb63-c4ed-42e8-bac7-71f6fa6df0b0 tempest-VolumesNegativeTest-938944593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5a180b5c-7687-4033-9141-c53d2c54624d" returned: 0 in 0.491s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a50adb63-c4ed-42e8-bac7-71f6fa6df0b0 tempest-VolumesNegativeTest-938944593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5a180b5c-7687-4033-9141-c53d2c54624d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:43 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-0c042487-5865-4122-95a8-2fe3070a67d7 tempest-VolumesTestJSON-1096091165 None] Created volume successfully. Apr 15 20:09:43 devstack sudo[87379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5a180b5c-7687-4033-9141-c53d2c54624d Apr 15 20:09:43 devstack sudo[87379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:43 devstack sudo[87373]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a45b7f3f-80f5-4df0-8b04-edf0b717b249 tempest-VolumesActionsTest-1982985722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-d7411715-f948-406c-bd85-0849440d86ea" returned: 0 in 0.428s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a45b7f3f-80f5-4df0-8b04-edf0b717b249 tempest-VolumesActionsTest-1982985722 None] Lock "cinder-quobyte-d7411715-f948-406c-bd85-0849440d86ea" released by "delete_volume" :: held 1.014s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-a45b7f3f-80f5-4df0-8b04-edf0b717b249 tempest-VolumesActionsTest-1982985722 None] Created reservations ['900bbc1e-7469-44ca-96e5-bb1e5158d304', '4c18fe76-1726-4c70-be54-a1de6a9e3fb1', 'da75e3e4-411d-4537-bf90-bd1fc4f25810', 'e9746bce-1faf-482f-b7c7-15f8afa12d37'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a45b7f3f-80f5-4df0-8b04-edf0b717b249 tempest-VolumesActionsTest-1982985722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a45b7f3f-80f5-4df0-8b04-edf0b717b249 tempest-VolumesActionsTest-1982985722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-a45b7f3f-80f5-4df0-8b04-edf0b717b249 tempest-VolumesActionsTest-1982985722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-a45b7f3f-80f5-4df0-8b04-edf0b717b249 tempest-VolumesActionsTest-1982985722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a45b7f3f-80f5-4df0-8b04-edf0b717b249 tempest-VolumesActionsTest-1982985722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a45b7f3f-80f5-4df0-8b04-edf0b717b249 tempest-VolumesActionsTest-1982985722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:43 devstack sudo[87383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:09:43 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:43 devstack sudo[87379]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a50adb63-c4ed-42e8-bac7-71f6fa6df0b0 tempest-VolumesNegativeTest-938944593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5a180b5c-7687-4033-9141-c53d2c54624d" returned: 0 in 0.403s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a50adb63-c4ed-42e8-bac7-71f6fa6df0b0 tempest-VolumesNegativeTest-938944593 None] Lock "cinder-quobyte-5a180b5c-7687-4033-9141-c53d2c54624d" released by "delete_volume" :: held 0.922s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-a50adb63-c4ed-42e8-bac7-71f6fa6df0b0 tempest-VolumesNegativeTest-938944593 None] Created reservations ['7eea53d5-4fde-409a-824c-5a4db3546c27', '65ae62ab-74a9-4edc-bf39-83e3008863d4', 'd72fdac2-4265-4997-b1bd-18032a58f94f', '6c1a0551-b13d-45b7-9a87-a40ca6975618'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a50adb63-c4ed-42e8-bac7-71f6fa6df0b0 tempest-VolumesNegativeTest-938944593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a50adb63-c4ed-42e8-bac7-71f6fa6df0b0 tempest-VolumesNegativeTest-938944593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-a50adb63-c4ed-42e8-bac7-71f6fa6df0b0 tempest-VolumesNegativeTest-938944593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-a50adb63-c4ed-42e8-bac7-71f6fa6df0b0 tempest-VolumesNegativeTest-938944593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a50adb63-c4ed-42e8-bac7-71f6fa6df0b0 tempest-VolumesNegativeTest-938944593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a50adb63-c4ed-42e8-bac7-71f6fa6df0b0 tempest-VolumesNegativeTest-938944593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:43 devstack sudo[87385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:09:43 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:43 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a45b7f3f-80f5-4df0-8b04-edf0b717b249 tempest-VolumesActionsTest-1982985722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.438s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-a45b7f3f-80f5-4df0-8b04-edf0b717b249 tempest-VolumesActionsTest-1982985722 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:09:43 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-a45b7f3f-80f5-4df0-8b04-edf0b717b249 tempest-VolumesActionsTest-1982985722 None] Deleted volume successfully. Apr 15 20:09:43 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a45b7f3f-80f5-4df0-8b04-edf0b717b249 tempest-VolumesActionsTest-1982985722 None] Lock "cinder-d7411715-f948-406c-bd85-0849440d86ea-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:44 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a50adb63-c4ed-42e8-bac7-71f6fa6df0b0 tempest-VolumesNegativeTest-938944593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.459s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-a50adb63-c4ed-42e8-bac7-71f6fa6df0b0 tempest-VolumesNegativeTest-938944593 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:09:44 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-a50adb63-c4ed-42e8-bac7-71f6fa6df0b0 tempest-VolumesNegativeTest-938944593 None] Deleted volume successfully. Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a50adb63-c4ed-42e8-bac7-71f6fa6df0b0 tempest-VolumesNegativeTest-938944593 None] Lock "cinder-5a180b5c-7687-4033-9141-c53d2c54624d-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Flow 'volume_create_manager' (4390d4fe-7986-43a3-991d-60ff2bdc5960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4172c95e-fe33-4c28-82e4-e010f8b19182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4172c95e-fe33-4c28-82e4-e010f8b19182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2014197553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fcea6a-84e0-4e71-9971-de73e4889cec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43f05526ade47a7abb3c1b9713bec1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:45Z,use_quota=True,user_id='98a347b66262405789be5d7550f06ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e871dc-c3dc-4cc4-9da1-dac1116da311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e871dc-c3dc-4cc4-9da1-dac1116da311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94587536-eecf-4c74-88ec-d9e0cb8da96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94587536-eecf-4c74-88ec-d9e0cb8da96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2fcea6a-84e0-4e71-9971-de73e4889cec', 'volume_name': 'volume-f2fcea6a-84e0-4e71-9971-de73e4889cec', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f84853-bdb8-4eac-ab7d-705f157b14d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f84853-bdb8-4eac-ab7d-705f157b14d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6dc867-53ac-4807-b2b7-5205e5ebe707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:44 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Volume f2fcea6a-84e0-4e71-9971-de73e4889cec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2fcea6a-84e0-4e71-9971-de73e4889cec', 'volume_size': 1} Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2014197553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fcea6a-84e0-4e71-9971-de73e4889cec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43f05526ade47a7abb3c1b9713bec1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:45Z,use_quota=True,user_id='98a347b66262405789be5d7550f06ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Creating volume f2fcea6a-84e0-4e71-9971-de73e4889cec {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:09:44 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2fcea6a-84e0-4e71-9971-de73e4889cec 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-28815a6e-f521-42f8-9a99-3230d9dcaebe tempest-VolumesTestJSON-1096091165 None] Acquiring lock "cinder-a8b01bd3-cead-4e72-acde-638a6a4b5a96-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:44 devstack sudo[87390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2fcea6a-84e0-4e71-9971-de73e4889cec 1073741824 Apr 15 20:09:44 devstack sudo[87390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:44 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-28815a6e-f521-42f8-9a99-3230d9dcaebe tempest-VolumesTestJSON-1096091165 None] Lock "cinder-a8b01bd3-cead-4e72-acde-638a6a4b5a96-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:45 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-28815a6e-f521-42f8-9a99-3230d9dcaebe tempest-VolumesTestJSON-1096091165 None] Acquiring lock "cinder-quobyte-a8b01bd3-cead-4e72-acde-638a6a4b5a96" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:45 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-28815a6e-f521-42f8-9a99-3230d9dcaebe tempest-VolumesTestJSON-1096091165 None] Lock "cinder-quobyte-a8b01bd3-cead-4e72-acde-638a6a4b5a96" acquired by "delete_volume" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:45 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eba831f-d7d4-4e7d-a6d5-366308828589]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:09:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-28815a6e-f521-42f8-9a99-3230d9dcaebe tempest-VolumesTestJSON-1096091165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a8b01bd3-cead-4e72-acde-638a6a4b5a96 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:45 devstack sudo[87392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a8b01bd3-cead-4e72-acde-638a6a4b5a96 Apr 15 20:09:45 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:45 devstack sudo[87390]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2fcea6a-84e0-4e71-9971-de73e4889cec 1073741824" returned: 0 in 0.566s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2fcea6a-84e0-4e71-9971-de73e4889cec {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:45 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:09:45 devstack sudo[87400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2fcea6a-84e0-4e71-9971-de73e4889cec Apr 15 20:09:45 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Flow 'volume_create_manager' (65fe030a-a2ef-44d2-9a64-133298e35b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:45 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd89d82-6540-4692-872c-72e0a0af2b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd89d82-6540-4692-872c-72e0a0af2b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1905473045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7635e499ddc54c4aa6a70e9f25372b3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:46Z,use_quota=True,user_id='7e1f60714db04f9dac336aff07edd09c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45a92a2-3ee2-4efa-8402-5f31db50d890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45a92a2-3ee2-4efa-8402-5f31db50d890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7826e26d-b80b-4fb3-b55d-cbeeb19e5223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7826e26d-b80b-4fb3-b55d-cbeeb19e5223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b', 'volume_name': 'volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b', 'volume_size': 2}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df15a787-950c-4bda-b042-5a50c2ce02cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df15a787-950c-4bda-b042-5a50c2ce02cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b078e7-cd62-4811-84a0-e4bbab8c1fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:45 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Volume 30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b', 'volume_size': 2} Apr 15 20:09:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-28815a6e-f521-42f8-9a99-3230d9dcaebe tempest-VolumesTestJSON-1096091165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a8b01bd3-cead-4e72-acde-638a6a4b5a96" returned: 0 in 0.600s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-28815a6e-f521-42f8-9a99-3230d9dcaebe tempest-VolumesTestJSON-1096091165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a8b01bd3-cead-4e72-acde-638a6a4b5a96 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:45 devstack sudo[87402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a8b01bd3-cead-4e72-acde-638a6a4b5a96 Apr 15 20:09:45 devstack sudo[87402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:46 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2fcea6a-84e0-4e71-9971-de73e4889cec" returned: 0 in 0.457s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.389s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1905473045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7635e499ddc54c4aa6a70e9f25372b3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:46Z,use_quota=True,user_id='7e1f60714db04f9dac336aff07edd09c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Creating volume 30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:09:46 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b 2147483648 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6dc867-53ac-4807-b2b7-5205e5ebe707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2fcea6a-84e0-4e71-9971-de73e4889cec', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:46 devstack sudo[87406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b 2147483648 Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc13c00d-6620-496d-abe2-57962763d35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:46 devstack sudo[87406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:46 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Volume volume-f2fcea6a-84e0-4e71-9971-de73e4889cec (f2fcea6a-84e0-4e71-9971-de73e4889cec): created successfully Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc13c00d-6620-496d-abe2-57962763d35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Flow 'volume_create_manager' (4390d4fe-7986-43a3-991d-60ff2bdc5960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:46 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-d672b30d-222c-46d9-ba8c-64efd2d0b130 tempest-VolumesActionsTest-590745200 None] Created volume successfully. Apr 15 20:09:46 devstack sudo[87402]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-28815a6e-f521-42f8-9a99-3230d9dcaebe tempest-VolumesTestJSON-1096091165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a8b01bd3-cead-4e72-acde-638a6a4b5a96" returned: 0 in 0.456s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-28815a6e-f521-42f8-9a99-3230d9dcaebe tempest-VolumesTestJSON-1096091165 None] Lock "cinder-quobyte-a8b01bd3-cead-4e72-acde-638a6a4b5a96" released by "delete_volume" :: held 1.083s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-28815a6e-f521-42f8-9a99-3230d9dcaebe tempest-VolumesTestJSON-1096091165 None] Created reservations ['1c07b8aa-aa87-4e57-8139-0ccb006ffc18', '3f1f4201-c7b8-4ffb-b2b4-1f7ddc61a9d7', '2d1f3d35-a650-4491-a4cb-074e80510cbf', 'efd6bfe0-baf3-44f8-9bec-73c166e3b711'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-28815a6e-f521-42f8-9a99-3230d9dcaebe tempest-VolumesTestJSON-1096091165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-28815a6e-f521-42f8-9a99-3230d9dcaebe tempest-VolumesTestJSON-1096091165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-28815a6e-f521-42f8-9a99-3230d9dcaebe tempest-VolumesTestJSON-1096091165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-28815a6e-f521-42f8-9a99-3230d9dcaebe tempest-VolumesTestJSON-1096091165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-28815a6e-f521-42f8-9a99-3230d9dcaebe tempest-VolumesTestJSON-1096091165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-28815a6e-f521-42f8-9a99-3230d9dcaebe tempest-VolumesTestJSON-1096091165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:46 devstack sudo[87408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:09:46 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:46 devstack sudo[87406]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b 2147483648" returned: 0 in 0.534s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:46 devstack sudo[87413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b Apr 15 20:09:46 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:46 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-28815a6e-f521-42f8-9a99-3230d9dcaebe tempest-VolumesTestJSON-1096091165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.489s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-28815a6e-f521-42f8-9a99-3230d9dcaebe tempest-VolumesTestJSON-1096091165 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:09:46 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-28815a6e-f521-42f8-9a99-3230d9dcaebe tempest-VolumesTestJSON-1096091165 None] Deleted volume successfully. Apr 15 20:09:46 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-28815a6e-f521-42f8-9a99-3230d9dcaebe tempest-VolumesTestJSON-1096091165 None] Lock "cinder-a8b01bd3-cead-4e72-acde-638a6a4b5a96-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:47 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b" returned: 0 in 0.419s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b078e7-cd62-4811-84a0-e4bbab8c1fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b', 'volume_size': 2}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb2f1a2-331b-4625-8355-f590d537893b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:47 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Volume volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b (30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b): created successfully Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb2f1a2-331b-4625-8355-f590d537893b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Flow 'volume_create_manager' (65fe030a-a2ef-44d2-9a64-133298e35b71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:47 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-b04d51c8-a46e-4665-a3aa-caa281a31562 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Created volume successfully. Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e265109f-6e4d-46c1-be6d-fa6eca79cf1b tempest-VolumesTestJSON-1096091165 None] Acquiring lock "cinder-80450c9d-9d16-486b-ad4f-56c7b17aa559-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-26c2a91e-125d-4b9a-830e-1580ddfc2e51 tempest-VolumesActionsTest-1982985722 None] Acquiring lock "cinder-f2fcea6a-84e0-4e71-9971-de73e4889cec-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e265109f-6e4d-46c1-be6d-fa6eca79cf1b tempest-VolumesTestJSON-1096091165 None] Lock "cinder-80450c9d-9d16-486b-ad4f-56c7b17aa559-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-26c2a91e-125d-4b9a-830e-1580ddfc2e51 tempest-VolumesActionsTest-1982985722 None] Lock "cinder-f2fcea6a-84e0-4e71-9971-de73e4889cec-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-26c2a91e-125d-4b9a-830e-1580ddfc2e51 tempest-VolumesActionsTest-1982985722 None] Acquiring lock "cinder-quobyte-f2fcea6a-84e0-4e71-9971-de73e4889cec" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-26c2a91e-125d-4b9a-830e-1580ddfc2e51 tempest-VolumesActionsTest-1982985722 None] Lock "cinder-quobyte-f2fcea6a-84e0-4e71-9971-de73e4889cec" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[a211abf3-d719-4510-add3-d7589dfc9ebd]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e265109f-6e4d-46c1-be6d-fa6eca79cf1b tempest-VolumesTestJSON-1096091165 None] Acquiring lock "cinder-quobyte-80450c9d-9d16-486b-ad4f-56c7b17aa559" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-26c2a91e-125d-4b9a-830e-1580ddfc2e51 tempest-VolumesActionsTest-1982985722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2fcea6a-84e0-4e71-9971-de73e4889cec {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e265109f-6e4d-46c1-be6d-fa6eca79cf1b tempest-VolumesTestJSON-1096091165 None] Lock "cinder-quobyte-80450c9d-9d16-486b-ad4f-56c7b17aa559" acquired by "delete_volume" :: waited 0.020s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4dd50b-b157-4f77-80f4-1915cf563c21]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e265109f-6e4d-46c1-be6d-fa6eca79cf1b tempest-VolumesTestJSON-1096091165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-80450c9d-9d16-486b-ad4f-56c7b17aa559 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:47 devstack sudo[87417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2fcea6a-84e0-4e71-9971-de73e4889cec Apr 15 20:09:47 devstack sudo[87417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:47 devstack sudo[87418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-80450c9d-9d16-486b-ad4f-56c7b17aa559 Apr 15 20:09:47 devstack sudo[87418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:47 devstack sudo[87417]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-26c2a91e-125d-4b9a-830e-1580ddfc2e51 tempest-VolumesActionsTest-1982985722 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2fcea6a-84e0-4e71-9971-de73e4889cec" returned: 0 in 0.486s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-26c2a91e-125d-4b9a-830e-1580ddfc2e51 tempest-VolumesActionsTest-1982985722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2fcea6a-84e0-4e71-9971-de73e4889cec {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:47 devstack sudo[87428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2fcea6a-84e0-4e71-9971-de73e4889cec Apr 15 20:09:47 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:47 devstack sudo[87418]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e265109f-6e4d-46c1-be6d-fa6eca79cf1b tempest-VolumesTestJSON-1096091165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-80450c9d-9d16-486b-ad4f-56c7b17aa559" returned: 0 in 0.540s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e265109f-6e4d-46c1-be6d-fa6eca79cf1b tempest-VolumesTestJSON-1096091165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-80450c9d-9d16-486b-ad4f-56c7b17aa559 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:47 devstack sudo[87430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-80450c9d-9d16-486b-ad4f-56c7b17aa559 Apr 15 20:09:47 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c90fd4b2-b40f-4fcb-adf5-4a9c51a181e2 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c90fd4b2-b40f-4fcb-adf5-4a9c51a181e2 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-c90fd4b2-b40f-4fcb-adf5-4a9c51a181e2 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Creating offline snapshot 201ef5dc-2c1a-40dc-bba6-b4ec6c974487 of volume 30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ac83d5-89e9-4cb2-8194-9019140797bc]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:09:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c90fd4b2-b40f-4fcb-adf5-4a9c51a181e2 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:47 devstack sudo[87432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b Apr 15 20:09:47 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:48 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-26c2a91e-125d-4b9a-830e-1580ddfc2e51 tempest-VolumesActionsTest-1982985722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2fcea6a-84e0-4e71-9971-de73e4889cec" returned: 0 in 0.439s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-26c2a91e-125d-4b9a-830e-1580ddfc2e51 tempest-VolumesActionsTest-1982985722 None] Lock "cinder-quobyte-f2fcea6a-84e0-4e71-9971-de73e4889cec" released by "delete_volume" :: held 0.953s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-26c2a91e-125d-4b9a-830e-1580ddfc2e51 tempest-VolumesActionsTest-1982985722 None] Created reservations ['a17ecdb0-66ce-4b9e-98a1-e3cb377eec0a', '9195acc9-3bda-4d35-a520-29c19e6ee80e', '08f314b1-980c-4016-b057-f4f4d0e6b687', 'b6f230af-147c-481f-87a0-7ac039b5284a'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-26c2a91e-125d-4b9a-830e-1580ddfc2e51 tempest-VolumesActionsTest-1982985722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-26c2a91e-125d-4b9a-830e-1580ddfc2e51 tempest-VolumesActionsTest-1982985722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-26c2a91e-125d-4b9a-830e-1580ddfc2e51 tempest-VolumesActionsTest-1982985722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-26c2a91e-125d-4b9a-830e-1580ddfc2e51 tempest-VolumesActionsTest-1982985722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-26c2a91e-125d-4b9a-830e-1580ddfc2e51 tempest-VolumesActionsTest-1982985722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-26c2a91e-125d-4b9a-830e-1580ddfc2e51 tempest-VolumesActionsTest-1982985722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:48 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e265109f-6e4d-46c1-be6d-fa6eca79cf1b tempest-VolumesTestJSON-1096091165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-80450c9d-9d16-486b-ad4f-56c7b17aa559" returned: 0 in 0.457s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e265109f-6e4d-46c1-be6d-fa6eca79cf1b tempest-VolumesTestJSON-1096091165 None] Lock "cinder-quobyte-80450c9d-9d16-486b-ad4f-56c7b17aa559" released by "delete_volume" :: held 1.022s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:48 devstack sudo[87436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:09:48 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-e265109f-6e4d-46c1-be6d-fa6eca79cf1b tempest-VolumesTestJSON-1096091165 None] Created reservations ['7727431a-be84-4149-8ad6-d1f67c17642d', '0602e70e-d987-4e7d-bae5-2c5310058647', 'b8c7cd7f-ea1c-44a1-a021-c2ad59c242d8', '2ca202f3-9aa1-4b3f-be3d-412bffef2c0c'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e265109f-6e4d-46c1-be6d-fa6eca79cf1b tempest-VolumesTestJSON-1096091165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e265109f-6e4d-46c1-be6d-fa6eca79cf1b tempest-VolumesTestJSON-1096091165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e265109f-6e4d-46c1-be6d-fa6eca79cf1b tempest-VolumesTestJSON-1096091165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e265109f-6e4d-46c1-be6d-fa6eca79cf1b tempest-VolumesTestJSON-1096091165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e265109f-6e4d-46c1-be6d-fa6eca79cf1b tempest-VolumesTestJSON-1096091165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e265109f-6e4d-46c1-be6d-fa6eca79cf1b tempest-VolumesTestJSON-1096091165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:48 devstack sudo[87441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:09:48 devstack sudo[87441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:48 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c90fd4b2-b40f-4fcb-adf5-4a9c51a181e2 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b" returned: 0 in 0.547s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c90fd4b2-b40f-4fcb-adf5-4a9c51a181e2 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.201ef5dc-2c1a-40dc-bba6-b4ec6c974487 2G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:48 devstack sudo[87443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.201ef5dc-2c1a-40dc-bba6-b4ec6c974487 2G Apr 15 20:09:48 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Flow 'volume_create_manager' (faefbf9c-4107-4112-a583-5de0d8f023b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f358cdb4-d41c-4aec-84d0-447d76bc373a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f358cdb4-d41c-4aec-84d0-447d76bc373a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-827434684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c03b3807-45e2-4e39-8f71-3092c506c13e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43f05526ade47a7abb3c1b9713bec1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:49Z,use_quota=True,user_id='98a347b66262405789be5d7550f06ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec997c11-ec67-4df8-9cd9-3a88d0ce48d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec997c11-ec67-4df8-9cd9-3a88d0ce48d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b587fc-31f2-4f87-b28d-e86da7506d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b587fc-31f2-4f87-b28d-e86da7506d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c03b3807-45e2-4e39-8f71-3092c506c13e', 'volume_name': 'volume-c03b3807-45e2-4e39-8f71-3092c506c13e', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f3aee19-5d51-43c8-a014-7d1200686b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f3aee19-5d51-43c8-a014-7d1200686b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c990da53-b2cc-47db-b154-010fcc06f598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:48 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Volume c03b3807-45e2-4e39-8f71-3092c506c13e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c03b3807-45e2-4e39-8f71-3092c506c13e', 'volume_size': 1} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:48 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-26c2a91e-125d-4b9a-830e-1580ddfc2e51 tempest-VolumesActionsTest-1982985722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.493s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-26c2a91e-125d-4b9a-830e-1580ddfc2e51 tempest-VolumesActionsTest-1982985722 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:09:48 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-26c2a91e-125d-4b9a-830e-1580ddfc2e51 tempest-VolumesActionsTest-1982985722 None] Deleted volume successfully. Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-26c2a91e-125d-4b9a-830e-1580ddfc2e51 tempest-VolumesActionsTest-1982985722 None] Lock "cinder-f2fcea6a-84e0-4e71-9971-de73e4889cec-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:48 devstack sudo[87441]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e265109f-6e4d-46c1-be6d-fa6eca79cf1b tempest-VolumesTestJSON-1096091165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.465s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-e265109f-6e4d-46c1-be6d-fa6eca79cf1b tempest-VolumesTestJSON-1096091165 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:09:48 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-e265109f-6e4d-46c1-be6d-fa6eca79cf1b tempest-VolumesTestJSON-1096091165 None] Deleted volume successfully. Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e265109f-6e4d-46c1-be6d-fa6eca79cf1b tempest-VolumesTestJSON-1096091165 None] Lock "cinder-80450c9d-9d16-486b-ad4f-56c7b17aa559-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:48 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c90fd4b2-b40f-4fcb-adf5-4a9c51a181e2 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.201ef5dc-2c1a-40dc-bba6-b4ec6c974487 2G" returned: 0 in 0.492s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c90fd4b2-b40f-4fcb-adf5-4a9c51a181e2 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.201ef5dc-2c1a-40dc-bba6-b4ec6c974487 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:48 devstack sudo[87450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.201ef5dc-2c1a-40dc-bba6-b4ec6c974487 Apr 15 20:09:48 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:49 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c90fd4b2-b40f-4fcb-adf5-4a9c51a181e2 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.201ef5dc-2c1a-40dc-bba6-b4ec6c974487" returned: 0 in 0.406s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:49 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-c90fd4b2-b40f-4fcb-adf5-4a9c51a181e2 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.201ef5dc-2c1a-40dc-bba6-b4ec6c974487 is being set with open permissions: ugo+rw Apr 15 20:09:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c90fd4b2-b40f-4fcb-adf5-4a9c51a181e2 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.201ef5dc-2c1a-40dc-bba6-b4ec6c974487 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b318a7f4-75e6-4022-86e4-4c9f2edc77b7 tempest-VolumesTestJSON-1096091165 None] Acquiring lock "cinder-6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:49 devstack sudo[87455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.201ef5dc-2c1a-40dc-bba6-b4ec6c974487 Apr 15 20:09:49 devstack sudo[87455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b318a7f4-75e6-4022-86e4-4c9f2edc77b7 tempest-VolumesTestJSON-1096091165 None] Lock "cinder-6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b318a7f4-75e6-4022-86e4-4c9f2edc77b7 tempest-VolumesTestJSON-1096091165 None] Acquiring lock "cinder-quobyte-6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b318a7f4-75e6-4022-86e4-4c9f2edc77b7 tempest-VolumesTestJSON-1096091165 None] Lock "cinder-quobyte-6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2" acquired by "delete_volume" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:49 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[62549f6c-1161-495f-b6d8-05d5be206201]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:09:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b318a7f4-75e6-4022-86e4-4c9f2edc77b7 tempest-VolumesTestJSON-1096091165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:49 devstack sudo[87457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2 Apr 15 20:09:49 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:49 devstack sudo[87455]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c90fd4b2-b40f-4fcb-adf5-4a9c51a181e2 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.201ef5dc-2c1a-40dc-bba6-b4ec6c974487" returned: 0 in 0.417s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c90fd4b2-b40f-4fcb-adf5-4a9c51a181e2 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:49 devstack sudo[87460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.info Apr 15 20:09:49 devstack sudo[87460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:49 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b318a7f4-75e6-4022-86e4-4c9f2edc77b7 tempest-VolumesTestJSON-1096091165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2" returned: 0 in 0.464s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b318a7f4-75e6-4022-86e4-4c9f2edc77b7 tempest-VolumesTestJSON-1096091165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:49 devstack sudo[87465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2 Apr 15 20:09:49 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:50 devstack sudo[87460]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c90fd4b2-b40f-4fcb-adf5-4a9c51a181e2 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.info" returned: 0 in 0.404s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:50 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-c90fd4b2-b40f-4fcb-adf5-4a9c51a181e2 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.info is being set with open permissions: ugo+rw Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c90fd4b2-b40f-4fcb-adf5-4a9c51a181e2 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:50 devstack sudo[87468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.info Apr 15 20:09:50 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:50 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b318a7f4-75e6-4022-86e4-4c9f2edc77b7 tempest-VolumesTestJSON-1096091165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2" returned: 0 in 0.418s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b318a7f4-75e6-4022-86e4-4c9f2edc77b7 tempest-VolumesTestJSON-1096091165 None] Lock "cinder-quobyte-6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2" released by "delete_volume" :: held 0.903s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-b318a7f4-75e6-4022-86e4-4c9f2edc77b7 tempest-VolumesTestJSON-1096091165 None] Created reservations ['00f1db5b-4817-4b51-8efe-249594c377e5', 'd018be68-3734-4fa3-9387-05fc20399b35', 'c925efb7-2f77-4b40-8f0d-ae3c3758d9e5', 'b1aa1a20-a8d1-4ad5-90ae-ff2c2351dc8b'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b318a7f4-75e6-4022-86e4-4c9f2edc77b7 tempest-VolumesTestJSON-1096091165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b318a7f4-75e6-4022-86e4-4c9f2edc77b7 tempest-VolumesTestJSON-1096091165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b318a7f4-75e6-4022-86e4-4c9f2edc77b7 tempest-VolumesTestJSON-1096091165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b318a7f4-75e6-4022-86e4-4c9f2edc77b7 tempest-VolumesTestJSON-1096091165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b318a7f4-75e6-4022-86e4-4c9f2edc77b7 tempest-VolumesTestJSON-1096091165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b318a7f4-75e6-4022-86e4-4c9f2edc77b7 tempest-VolumesTestJSON-1096091165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:50 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:09:50 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:50 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c90fd4b2-b40f-4fcb-adf5-4a9c51a181e2 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.info" returned: 0 in 0.428s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c90fd4b2-b40f-4fcb-adf5-4a9c51a181e2 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.749s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.926s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-827434684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c03b3807-45e2-4e39-8f71-3092c506c13e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43f05526ade47a7abb3c1b9713bec1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:49Z,use_quota=True,user_id='98a347b66262405789be5d7550f06ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Creating volume c03b3807-45e2-4e39-8f71-3092c506c13e {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:09:50 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c03b3807-45e2-4e39-8f71-3092c506c13e 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:50 devstack sudo[87474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c03b3807-45e2-4e39-8f71-3092c506c13e 1073741824 Apr 15 20:09:50 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:50 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-c90fd4b2-b40f-4fcb-adf5-4a9c51a181e2 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Create snapshot completed successfully Apr 15 20:09:50 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b318a7f4-75e6-4022-86e4-4c9f2edc77b7 tempest-VolumesTestJSON-1096091165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.501s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-b318a7f4-75e6-4022-86e4-4c9f2edc77b7 tempest-VolumesTestJSON-1096091165 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:09:50 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-b318a7f4-75e6-4022-86e4-4c9f2edc77b7 tempest-VolumesTestJSON-1096091165 None] Deleted volume successfully. Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b318a7f4-75e6-4022-86e4-4c9f2edc77b7 tempest-VolumesTestJSON-1096091165 None] Lock "cinder-6b3c0ed0-34d1-4ed8-86e2-c8d15cc63cf2-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e0bc4610-97bd-489f-b735-10969a307363 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Acquiring lock "cinder-201ef5dc-2c1a-40dc-bba6-b4ec6c974487-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e0bc4610-97bd-489f-b735-10969a307363 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Lock "cinder-201ef5dc-2c1a-40dc-bba6-b4ec6c974487-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:50 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e0bc4610-97bd-489f-b735-10969a307363 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Acquiring lock "cinder-quobyte-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:51 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e0bc4610-97bd-489f-b735-10969a307363 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Lock "cinder-quobyte-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:51 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e0bc4610-97bd-489f-b735-10969a307363 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Acquiring lock "cinder-quobyte-201ef5dc-2c1a-40dc-bba6-b4ec6c974487" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:51 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e0bc4610-97bd-489f-b735-10969a307363 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Lock "cinder-quobyte-201ef5dc-2c1a-40dc-bba6-b4ec6c974487" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:51 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-e0bc4610-97bd-489f-b735-10969a307363 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Deleting offline snapshot 201ef5dc-2c1a-40dc-bba6-b4ec6c974487 of volume 30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:09:51 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-e0bc4610-97bd-489f-b735-10969a307363 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] snapshot_file for this snap is: volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.201ef5dc-2c1a-40dc-bba6-b4ec6c974487 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:09:51 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2f3c40-6fef-471c-8bd1-9da0dd5c0696]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:09:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e0bc4610-97bd-489f-b735-10969a307363 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.201ef5dc-2c1a-40dc-bba6-b4ec6c974487 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:51 devstack sudo[87480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.201ef5dc-2c1a-40dc-bba6-b4ec6c974487 Apr 15 20:09:51 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:51 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c03b3807-45e2-4e39-8f71-3092c506c13e 1073741824" returned: 0 in 0.610s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c03b3807-45e2-4e39-8f71-3092c506c13e {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:51 devstack sudo[87482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c03b3807-45e2-4e39-8f71-3092c506c13e Apr 15 20:09:51 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:51 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e0bc4610-97bd-489f-b735-10969a307363 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.201ef5dc-2c1a-40dc-bba6-b4ec6c974487" returned: 0 in 0.523s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:51 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-e0bc4610-97bd-489f-b735-10969a307363 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:09:51 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f6a2a6-8d53-42dd-bf35-e851d74117e2]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:09:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e0bc4610-97bd-489f-b735-10969a307363 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:51 devstack sudo[87488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b Apr 15 20:09:51 devstack sudo[87488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:51 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c03b3807-45e2-4e39-8f71-3092c506c13e" returned: 0 in 0.467s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:51 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:09:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c990da53-b2cc-47db-b154-010fcc06f598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c03b3807-45e2-4e39-8f71-3092c506c13e', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc79844-da26-49cb-a3ea-85db66c4ca39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:51 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Volume volume-c03b3807-45e2-4e39-8f71-3092c506c13e (c03b3807-45e2-4e39-8f71-3092c506c13e): created successfully Apr 15 20:09:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc79844-da26-49cb-a3ea-85db66c4ca39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Flow 'volume_create_manager' (faefbf9c-4107-4112-a583-5de0d8f023b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:51 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-3e19d6c1-5883-473b-9116-6cbbd41079fa tempest-VolumesActionsTest-590745200 None] Created volume successfully. Apr 15 20:09:52 devstack sudo[87488]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e0bc4610-97bd-489f-b735-10969a307363 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b" returned: 0 in 0.508s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e0bc4610-97bd-489f-b735-10969a307363 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.201ef5dc-2c1a-40dc-bba6-b4ec6c974487 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:52 devstack sudo[87496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.201ef5dc-2c1a-40dc-bba6-b4ec6c974487 Apr 15 20:09:52 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:52 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e0bc4610-97bd-489f-b735-10969a307363 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.201ef5dc-2c1a-40dc-bba6-b4ec6c974487" returned: 0 in 0.501s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e0bc4610-97bd-489f-b735-10969a307363 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.201ef5dc-2c1a-40dc-bba6-b4ec6c974487 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:52 devstack sudo[87501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.201ef5dc-2c1a-40dc-bba6-b4ec6c974487 Apr 15 20:09:52 devstack sudo[87501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:52 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-ae173121-415e-4a2e-8b82-0b7371d521ce tempest-GroupSnapshotsTest-57414795 None] Group tempest-GroupSnapshotsTest-Group-49393214: creating Apr 15 20:09:52 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-ae173121-415e-4a2e-8b82-0b7371d521ce tempest-GroupSnapshotsTest-57414795 None] Group tempest-GroupSnapshotsTest-Group-49393214: created successfully Apr 15 20:09:52 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-ae173121-415e-4a2e-8b82-0b7371d521ce tempest-GroupSnapshotsTest-57414795 None] Create group completed successfully. Apr 15 20:09:53 devstack sudo[87501]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e0bc4610-97bd-489f-b735-10969a307363 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b.201ef5dc-2c1a-40dc-bba6-b4ec6c974487" returned: 0 in 0.433s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:53 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e0bc4610-97bd-489f-b735-10969a307363 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Lock "cinder-quobyte-201ef5dc-2c1a-40dc-bba6-b4ec6c974487" released by "_delete_snapshot" :: held 2.041s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:53 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e0bc4610-97bd-489f-b735-10969a307363 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Lock "cinder-quobyte-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b" released by "delete_snapshot" :: held 2.058s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:53 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-e0bc4610-97bd-489f-b735-10969a307363 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Created reservations ['87265985-c9bb-4fad-973a-44c8fea4363d', '984eaaa3-af3f-4f71-ab1d-f3f15af98f1d', 'bc4f5be8-befc-4ea6-929c-3aa7ed7cde23', 'a106abc6-2c3a-49ea-94ed-b63d8d092f5a'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:09:53 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-e0bc4610-97bd-489f-b735-10969a307363 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Delete snapshot completed successfully. Apr 15 20:09:53 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e0bc4610-97bd-489f-b735-10969a307363 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Lock "cinder-201ef5dc-2c1a-40dc-bba6-b4ec6c974487-delete_snapshot" released by "delete_snapshot" :: held 2.165s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:53 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6b77c827-525f-4a40-97a2-7d4daf9c77be tempest-VolumesActionsTest-590745200 None] Acquiring lock "cinder-c03b3807-45e2-4e39-8f71-3092c506c13e-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:53 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6b77c827-525f-4a40-97a2-7d4daf9c77be tempest-VolumesActionsTest-590745200 None] Lock "cinder-c03b3807-45e2-4e39-8f71-3092c506c13e-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:53 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6b77c827-525f-4a40-97a2-7d4daf9c77be tempest-VolumesActionsTest-590745200 None] Acquiring lock "cinder-quobyte-c03b3807-45e2-4e39-8f71-3092c506c13e" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:53 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6b77c827-525f-4a40-97a2-7d4daf9c77be tempest-VolumesActionsTest-590745200 None] Lock "cinder-quobyte-c03b3807-45e2-4e39-8f71-3092c506c13e" acquired by "delete_volume" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:53 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b3217a-72d3-4ee0-8222-e3cc598ba215]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:09:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6b77c827-525f-4a40-97a2-7d4daf9c77be tempest-VolumesActionsTest-590745200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c03b3807-45e2-4e39-8f71-3092c506c13e {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:53 devstack sudo[87504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c03b3807-45e2-4e39-8f71-3092c506c13e Apr 15 20:09:53 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:53 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6b77c827-525f-4a40-97a2-7d4daf9c77be tempest-VolumesActionsTest-590745200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c03b3807-45e2-4e39-8f71-3092c506c13e" returned: 0 in 0.451s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6b77c827-525f-4a40-97a2-7d4daf9c77be tempest-VolumesActionsTest-590745200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c03b3807-45e2-4e39-8f71-3092c506c13e {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:53 devstack sudo[87509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c03b3807-45e2-4e39-8f71-3092c506c13e Apr 15 20:09:53 devstack sudo[87509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Flow 'volume_create_manager' (6fd3a781-93b4-4396-9f1d-65153d645254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29071875-17a0-4086-b267-ac6866e48aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9b7deb3d-f320-41be-ad75-ba542648d954 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Acquiring lock "cinder-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29071875-17a0-4086-b267-ac6866e48aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-78703774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4da57437-6538-4907-b976-9953b3746340,host='devstack@QuobyteHD#QuobyteHD',id=4d3749cc-929c-4f3f-82b5-de941b4050eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2478e26b98964590aaa0437bc826fd28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:54Z,use_quota=True,user_id='a471c8f5d63048458961f9b21a24a704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5af231c-7ae9-4ddb-8987-63c76591805b),volume_type_id=e5af231c-7ae9-4ddb-8987-63c76591805b)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4bf774b-c092-471d-a477-25a21b1f8b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4bf774b-c092-471d-a477-25a21b1f8b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:54 devstack sudo[87509]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b19f7c-7cb5-4da1-983f-ae0102fefc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b19f7c-7cb5-4da1-983f-ae0102fefc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d3749cc-929c-4f3f-82b5-de941b4050eb', 'volume_name': 'volume-4d3749cc-929c-4f3f-82b5-de941b4050eb', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1847923-b7f5-468c-8b4e-3afd5e64149d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1847923-b7f5-468c-8b4e-3afd5e64149d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1019bb72-7241-4acd-8e0b-0385f65c43e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:54 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Volume 4d3749cc-929c-4f3f-82b5-de941b4050eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d3749cc-929c-4f3f-82b5-de941b4050eb', 'volume_size': 1} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4da57437-6538-4907-b976-9953b3746340,created_at=2026-04-15T18:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-78703774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4da57437-6538-4907-b976-9953b3746340,host='devstack@QuobyteHD#QuobyteHD',id=4d3749cc-929c-4f3f-82b5-de941b4050eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2478e26b98964590aaa0437bc826fd28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:54Z,use_quota=True,user_id='a471c8f5d63048458961f9b21a24a704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5af231c-7ae9-4ddb-8987-63c76591805b),volume_type_id=e5af231c-7ae9-4ddb-8987-63c76591805b)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Creating volume 4d3749cc-929c-4f3f-82b5-de941b4050eb {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:09:54 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6b77c827-525f-4a40-97a2-7d4daf9c77be tempest-VolumesActionsTest-590745200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c03b3807-45e2-4e39-8f71-3092c506c13e" returned: 0 in 0.488s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9b7deb3d-f320-41be-ad75-ba542648d954 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Lock "cinder-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:54 devstack sudo[87512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb 1073741824 Apr 15 20:09:54 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6b77c827-525f-4a40-97a2-7d4daf9c77be tempest-VolumesActionsTest-590745200 None] Lock "cinder-quobyte-c03b3807-45e2-4e39-8f71-3092c506c13e" released by "delete_volume" :: held 0.968s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-6b77c827-525f-4a40-97a2-7d4daf9c77be tempest-VolumesActionsTest-590745200 None] Created reservations ['5ff9b93e-fb26-4c29-aa31-d62674e9f111', '25d43cb4-23b8-4c3a-93ec-dd435aeed212', '4ae85a37-659f-4c5d-beb9-4490a1bfd03c', 'f16cb5b8-5c17-47ac-a1d3-30c10f08d27e'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9b7deb3d-f320-41be-ad75-ba542648d954 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Acquiring lock "cinder-quobyte-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-6b77c827-525f-4a40-97a2-7d4daf9c77be tempest-VolumesActionsTest-590745200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-6b77c827-525f-4a40-97a2-7d4daf9c77be tempest-VolumesActionsTest-590745200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-6b77c827-525f-4a40-97a2-7d4daf9c77be tempest-VolumesActionsTest-590745200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-6b77c827-525f-4a40-97a2-7d4daf9c77be tempest-VolumesActionsTest-590745200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-6b77c827-525f-4a40-97a2-7d4daf9c77be tempest-VolumesActionsTest-590745200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6b77c827-525f-4a40-97a2-7d4daf9c77be tempest-VolumesActionsTest-590745200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9b7deb3d-f320-41be-ad75-ba542648d954 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Lock "cinder-quobyte-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b" acquired by "delete_volume" :: waited 0.023s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:09:54 devstack sudo[87514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:09:54 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5acdd16-312f-4794-8dbd-a199b55e0e76]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9b7deb3d-f320-41be-ad75-ba542648d954 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:54 devstack sudo[87516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b Apr 15 20:09:54 devstack sudo[87516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:54 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb 1073741824" returned: 0 in 0.543s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:54 devstack sudo[87522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb Apr 15 20:09:54 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:54 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6b77c827-525f-4a40-97a2-7d4daf9c77be tempest-VolumesActionsTest-590745200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.490s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-6b77c827-525f-4a40-97a2-7d4daf9c77be tempest-VolumesActionsTest-590745200 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:09:54 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-6b77c827-525f-4a40-97a2-7d4daf9c77be tempest-VolumesActionsTest-590745200 None] Deleted volume successfully. Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6b77c827-525f-4a40-97a2-7d4daf9c77be tempest-VolumesActionsTest-590745200 None] Lock "cinder-c03b3807-45e2-4e39-8f71-3092c506c13e-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:54 devstack sudo[87516]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9b7deb3d-f320-41be-ad75-ba542648d954 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b" returned: 0 in 0.532s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9b7deb3d-f320-41be-ad75-ba542648d954 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:54 devstack sudo[87527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b Apr 15 20:09:54 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:55 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb" returned: 0 in 0.423s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:09:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1019bb72-7241-4acd-8e0b-0385f65c43e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d3749cc-929c-4f3f-82b5-de941b4050eb', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef79719-e6ab-4b84-9488-2f1911e0e41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:55 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Volume volume-4d3749cc-929c-4f3f-82b5-de941b4050eb (4d3749cc-929c-4f3f-82b5-de941b4050eb): created successfully Apr 15 20:09:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef79719-e6ab-4b84-9488-2f1911e0e41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Flow 'volume_create_manager' (6fd3a781-93b4-4396-9f1d-65153d645254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:55 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-54ccb8db-7588-4b25-b8ab-8ab49972b21f tempest-GroupSnapshotsTest-57414795 None] Created volume successfully. Apr 15 20:09:55 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9b7deb3d-f320-41be-ad75-ba542648d954 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b" returned: 0 in 0.434s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:55 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9b7deb3d-f320-41be-ad75-ba542648d954 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Lock "cinder-quobyte-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b" released by "delete_volume" :: held 1.004s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:55 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-9b7deb3d-f320-41be-ad75-ba542648d954 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Created reservations ['07a81a61-9277-47bb-9ed6-39a12e3ec849', 'f649ea4d-9330-4d96-8064-8e8f943f1502', 'a68eb1e0-b90b-474b-9fa0-b1f7492cffe8', '1a435367-3c08-4f75-82b6-12a0c2649443'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:09:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9b7deb3d-f320-41be-ad75-ba542648d954 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9b7deb3d-f320-41be-ad75-ba542648d954 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9b7deb3d-f320-41be-ad75-ba542648d954 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9b7deb3d-f320-41be-ad75-ba542648d954 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9b7deb3d-f320-41be-ad75-ba542648d954 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9b7deb3d-f320-41be-ad75-ba542648d954 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:55 devstack sudo[87532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:09:55 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:55 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9b7deb3d-f320-41be-ad75-ba542648d954 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.444s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:55 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-9b7deb3d-f320-41be-ad75-ba542648d954 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:09:55 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-9b7deb3d-f320-41be-ad75-ba542648d954 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Deleted volume successfully. Apr 15 20:09:55 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9b7deb3d-f320-41be-ad75-ba542648d954 tempest-VolumesSnapshotNegativeTestJSON-167063109 None] Lock "cinder-30230ed7-7fa8-4e8f-9abf-0d16b55d9b3b-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:09:56 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-0b9b42a9-4fad-4736-9e82-7ebc30d011e1 tempest-GroupSnapshotsTest-57414795 None] GroupSnapshot 68e93c79-4b8d-4e3c-98c8-bed8197fd0f3: creating. Apr 15 20:09:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0b9b42a9-4fad-4736-9e82-7ebc30d011e1 tempest-GroupSnapshotsTest-57414795 None] Group snapshot 68e93c79-4b8d-4e3c-98c8-bed8197fd0f3: creating. {{(pid=82989) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 20:09:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0b9b42a9-4fad-4736-9e82-7ebc30d011e1 tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0b9b42a9-4fad-4736-9e82-7ebc30d011e1 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:56 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-0b9b42a9-4fad-4736-9e82-7ebc30d011e1 tempest-GroupSnapshotsTest-57414795 None] Creating offline snapshot 8aff695a-de70-4e24-9c4a-2731c331d0c6 of volume 4d3749cc-929c-4f3f-82b5-de941b4050eb {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:09:56 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[234bcd22-196f-4986-ba57-4449e75b1611]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:09:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0b9b42a9-4fad-4736-9e82-7ebc30d011e1 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:56 devstack sudo[87535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb Apr 15 20:09:56 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:57 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0b9b42a9-4fad-4736-9e82-7ebc30d011e1 tempest-GroupSnapshotsTest-57414795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb" returned: 0 in 0.600s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0b9b42a9-4fad-4736-9e82-7ebc30d011e1 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.8aff695a-de70-4e24-9c4a-2731c331d0c6 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:57 devstack sudo[87541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.8aff695a-de70-4e24-9c4a-2731c331d0c6 1G Apr 15 20:09:57 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:57 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0b9b42a9-4fad-4736-9e82-7ebc30d011e1 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.8aff695a-de70-4e24-9c4a-2731c331d0c6 1G" returned: 0 in 0.621s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0b9b42a9-4fad-4736-9e82-7ebc30d011e1 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d3749cc-929c-4f3f-82b5-de941b4050eb -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.8aff695a-de70-4e24-9c4a-2731c331d0c6 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:57 devstack sudo[87546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d3749cc-929c-4f3f-82b5-de941b4050eb -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.8aff695a-de70-4e24-9c4a-2731c331d0c6 Apr 15 20:09:57 devstack sudo[87546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:58 devstack sudo[87546]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0b9b42a9-4fad-4736-9e82-7ebc30d011e1 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d3749cc-929c-4f3f-82b5-de941b4050eb -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.8aff695a-de70-4e24-9c4a-2731c331d0c6" returned: 0 in 0.496s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:58 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-0b9b42a9-4fad-4736-9e82-7ebc30d011e1 tempest-GroupSnapshotsTest-57414795 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.8aff695a-de70-4e24-9c4a-2731c331d0c6 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 20:09:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0b9b42a9-4fad-4736-9e82-7ebc30d011e1 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.8aff695a-de70-4e24-9c4a-2731c331d0c6 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:58 devstack sudo[87552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.8aff695a-de70-4e24-9c4a-2731c331d0c6 Apr 15 20:09:58 devstack sudo[87552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:58 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:09:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Flow 'volume_create_manager' (e02d62fd-9f57-40bc-8e63-3cd9e63f093d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:09:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5610978-c08b-4c3c-8fd4-d5b79692ed77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5610978-c08b-4c3c-8fd4-d5b79692ed77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1120820893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f3ae10-a7ba-4baf-9341-54600bcd3d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5510f5d10ce495d99b71244226a8809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:58Z,use_quota=True,user_id='b4f58d540ae147f1bc8a6b946ff3b330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61c20f8-309f-4e24-9743-694f5b30b44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61c20f8-309f-4e24-9743-694f5b30b44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d441676a-9ed6-412d-b9c0-f93f12d22cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d441676a-9ed6-412d-b9c0-f93f12d22cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83f3ae10-a7ba-4baf-9341-54600bcd3d88', 'volume_name': 'volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9402c3f-61f9-42e3-b576-70a5b06517c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9402c3f-61f9-42e3-b576-70a5b06517c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:09:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (469cd502-eb6b-450a-8f9a-d59c68f338af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:09:58 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Volume 83f3ae10-a7ba-4baf-9341-54600bcd3d88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88', 'volume_size': 1} Apr 15 20:09:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:58 devstack sudo[87552]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0b9b42a9-4fad-4736-9e82-7ebc30d011e1 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.8aff695a-de70-4e24-9c4a-2731c331d0c6" returned: 0 in 0.443s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0b9b42a9-4fad-4736-9e82-7ebc30d011e1 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:58 devstack sudo[87555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.info Apr 15 20:09:58 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:59 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0b9b42a9-4fad-4736-9e82-7ebc30d011e1 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.info" returned: 0 in 0.424s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:59 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-0b9b42a9-4fad-4736-9e82-7ebc30d011e1 tempest-GroupSnapshotsTest-57414795 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 20:09:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0b9b42a9-4fad-4736-9e82-7ebc30d011e1 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:59 devstack sudo[87558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.info Apr 15 20:09:59 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:59 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root Apr 15 20:09:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0b9b42a9-4fad-4736-9e82-7ebc30d011e1 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.info" returned: 0 in 0.452s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:09:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0b9b42a9-4fad-4736-9e82-7ebc30d011e1 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.096s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.196s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:59 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1120820893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f3ae10-a7ba-4baf-9341-54600bcd3d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5510f5d10ce495d99b71244226a8809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:09:58Z,use_quota=True,user_id='b4f58d540ae147f1bc8a6b946ff3b330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:09:59 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Creating volume 83f3ae10-a7ba-4baf-9341-54600bcd3d88 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:09:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:09:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:09:59 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:09:59 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:09:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:09:59 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:09:59 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:09:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:09:59 devstack sudo[87561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 1073741824 Apr 15 20:09:59 devstack sudo[87561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:09:59 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-0b9b42a9-4fad-4736-9e82-7ebc30d011e1 tempest-GroupSnapshotsTest-57414795 None] group_snapshot 68e93c79-4b8d-4e3c-98c8-bed8197fd0f3: created successfully Apr 15 20:10:00 devstack sudo[87561]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 1073741824" returned: 0 in 0.558s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:00 devstack sudo[87567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 Apr 15 20:10:00 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:00 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88" returned: 0 in 0.437s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:10:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (469cd502-eb6b-450a-8f9a-d59c68f338af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf89e711-55c1-4b84-852d-fea303c63370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:00 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Volume volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 (83f3ae10-a7ba-4baf-9341-54600bcd3d88): created successfully Apr 15 20:10:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf89e711-55c1-4b84-852d-fea303c63370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Flow 'volume_create_manager' (e02d62fd-9f57-40bc-8e63-3cd9e63f093d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:00 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-2483eb32-6969-4b94-97bb-559afb99fea4 tempest-VolumeDependencyTests-1373956501 None] Created volume successfully. Apr 15 20:10:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1236c914-d238-418b-9673-4cca11cd64f7 tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1236c914-d238-418b-9673-4cca11cd64f7 tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:01 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-1236c914-d238-418b-9673-4cca11cd64f7 tempest-VolumeDependencyTests-1373956501 None] Creating offline snapshot 1c7406d0-9b76-4c1b-bc81-1bee469e4889 of volume 83f3ae10-a7ba-4baf-9341-54600bcd3d88 {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:10:01 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[77588721-add4-448f-8dab-112162f01be8]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1236c914-d238-418b-9673-4cca11cd64f7 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:01 devstack sudo[87576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 Apr 15 20:10:01 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:02 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1236c914-d238-418b-9673-4cca11cd64f7 tempest-VolumeDependencyTests-1373956501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88" returned: 0 in 0.484s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1236c914-d238-418b-9673-4cca11cd64f7 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.1c7406d0-9b76-4c1b-bc81-1bee469e4889 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:02 devstack sudo[87582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.1c7406d0-9b76-4c1b-bc81-1bee469e4889 1G Apr 15 20:10:02 devstack sudo[87582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:02 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:10:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Flow 'volume_create_manager' (ae3a2383-8642-491d-829b-f01b7fdd5eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e2bc8fa-ee71-4d63-9bc5-d4fee6df7d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e2bc8fa-ee71-4d63-9bc5-d4fee6df7d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1288115453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8cae311-f383-471c-9da0-aff91949cd2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875a67dd2dd847be9906f3271ee20876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:02Z,use_quota=True,user_id='eafbc1aaf15f4c7498547e8789e92faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8159e67-7c56-48ce-8b3f-898dfede3a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8159e67-7c56-48ce-8b3f-898dfede3a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d08382-08f7-42bf-b08d-d4f4f7985de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d08382-08f7-42bf-b08d-d4f4f7985de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8cae311-f383-471c-9da0-aff91949cd2a', 'volume_name': 'volume-c8cae311-f383-471c-9da0-aff91949cd2a', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d69c14ec-e529-4902-a714-0e592b91cbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d69c14ec-e529-4902-a714-0e592b91cbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055146b1-d5d8-4d06-a1f9-adb46d7e4d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:02 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Volume c8cae311-f383-471c-9da0-aff91949cd2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8cae311-f383-471c-9da0-aff91949cd2a', 'volume_size': 1} Apr 15 20:10:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:02 devstack sudo[87582]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1236c914-d238-418b-9673-4cca11cd64f7 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.1c7406d0-9b76-4c1b-bc81-1bee469e4889 1G" returned: 0 in 0.537s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1236c914-d238-418b-9673-4cca11cd64f7 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.1c7406d0-9b76-4c1b-bc81-1bee469e4889 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:02 devstack sudo[87587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.1c7406d0-9b76-4c1b-bc81-1bee469e4889 Apr 15 20:10:02 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:03 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1236c914-d238-418b-9673-4cca11cd64f7 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.1c7406d0-9b76-4c1b-bc81-1bee469e4889" returned: 0 in 0.412s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:03 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-1236c914-d238-418b-9673-4cca11cd64f7 tempest-VolumeDependencyTests-1373956501 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.1c7406d0-9b76-4c1b-bc81-1bee469e4889 is being set with open permissions: ugo+rw Apr 15 20:10:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1236c914-d238-418b-9673-4cca11cd64f7 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.1c7406d0-9b76-4c1b-bc81-1bee469e4889 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:03 devstack sudo[87592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.1c7406d0-9b76-4c1b-bc81-1bee469e4889 Apr 15 20:10:03 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:03 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1236c914-d238-418b-9673-4cca11cd64f7 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.1c7406d0-9b76-4c1b-bc81-1bee469e4889" returned: 0 in 0.402s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1236c914-d238-418b-9673-4cca11cd64f7 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:03 devstack sudo[87595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.info Apr 15 20:10:03 devstack sudo[87595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:04 devstack sudo[87595]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1236c914-d238-418b-9673-4cca11cd64f7 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.info" returned: 0 in 0.477s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:04 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-1236c914-d238-418b-9673-4cca11cd64f7 tempest-VolumeDependencyTests-1373956501 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.info is being set with open permissions: ugo+rw Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1236c914-d238-418b-9673-4cca11cd64f7 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:04 devstack sudo[87598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.info Apr 15 20:10:04 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:04 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1236c914-d238-418b-9673-4cca11cd64f7 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.info" returned: 0 in 0.387s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1236c914-d238-418b-9673-4cca11cd64f7 tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.765s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.768s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "cinder-quobyte-8aff695a-de70-4e24-9c4a-2731c331d0c6-5af5315f-3926-4cf2-af77-f0f7eeaed52d" by "_create_volume_from_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-8aff695a-de70-4e24-9c4a-2731c331d0c6-5af5315f-3926-4cf2-af77-f0f7eeaed52d" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Creating volume 5af5315f-3926-4cf2-af77-f0f7eeaed52d from snapshot 8aff695a-de70-4e24-9c4a-2731c331d0c6 {{(pid=82989) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "cinder-quobyte-5af5315f-3926-4cf2-af77-f0f7eeaed52d" by "_copy_volume_from_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:04 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-1236c914-d238-418b-9673-4cca11cd64f7 tempest-VolumeDependencyTests-1373956501 None] Create snapshot completed successfully Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-5af5315f-3926-4cf2-af77-f0f7eeaed52d" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] snapshot: 8aff695a-de70-4e24-9c4a-2731c331d0c6, volume: 5af5315f-3926-4cf2-af77-f0f7eeaed52d, {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[265ea6ae-3301-48f6-ad22-68d5221e024c]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.8aff695a-de70-4e24-9c4a-2731c331d0c6 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:04 devstack sudo[87601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.8aff695a-de70-4e24-9c4a-2731c331d0c6 Apr 15 20:10:04 devstack sudo[87601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:05 devstack sudo[87601]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.8aff695a-de70-4e24-9c4a-2731c331d0c6" returned: 0 in 0.496s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d3749cc-929c-4f3f-82b5-de941b4050eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:10:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 20:10:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Creating direct copy from snapshot {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 20:10:05 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ddab77-1f90-4468-b366-b94e2fea986c]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:05 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:10:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Flow 'volume_create_manager' (a7a32f33-e9b6-46c5-97c5-103629bd7f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d328f5-da18-4c47-b50c-20137a0d52e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:05 devstack sudo[87606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb Apr 15 20:10:05 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d328f5-da18-4c47-b50c-20137a0d52e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-202783502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea781f8-55e3-4094-9c13-c908a7147ff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5510f5d10ce495d99b71244226a8809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1c7406d0-9b76-4c1b-bc81-1bee469e4889,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:05Z,use_quota=True,user_id='b4f58d540ae147f1bc8a6b946ff3b330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c98dd8-f05c-4b08-8ca2-54292067643c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c98dd8-f05c-4b08-8ca2-54292067643c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189193bb-edcd-4dfe-983b-c3f943cff6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189193bb-edcd-4dfe-983b-c3f943cff6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eea781f8-55e3-4094-9c13-c908a7147ff6', 'volume_name': 'volume-eea781f8-55e3-4094-9c13-c908a7147ff6', 'volume_size': 1, 'snapshot_id': '1c7406d0-9b76-4c1b-bc81-1bee469e4889'}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c071f7ad-b3ca-4ed8-bd12-63a23e89ce5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c071f7ad-b3ca-4ed8-bd12-63a23e89ce5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20e194c-089a-4110-a0cf-201442f73002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:05 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Volume eea781f8-55e3-4094-9c13-c908a7147ff6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eea781f8-55e3-4094-9c13-c908a7147ff6', 'volume_size': 1, 'snapshot_id': '1c7406d0-9b76-4c1b-bc81-1bee469e4889'} Apr 15 20:10:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:05 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb" returned: 0 in 0.451s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:05 devstack cinder-volume[82989]: DEBUG cinder.utils [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Path /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5af5315f-3926-4cf2-af77-f0f7eeaed52d not found in is_blk_device check {{(pid=82989) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 20:10:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5af5315f-3926-4cf2-af77-f0f7eeaed52d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:05 devstack sudo[87611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5af5315f-3926-4cf2-af77-f0f7eeaed52d Apr 15 20:10:05 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:07 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5af5315f-3926-4cf2-af77-f0f7eeaed52d" returned: 0 in 1.785s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:07 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aba5201-afde-44c2-b097-f8cd0b94b20b]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:07 devstack sudo[87624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb Apr 15 20:10:07 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:07 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb" returned: 0 in 0.556s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:07 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb, size 1024.00 MB, duration 1.79 sec, destination /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5af5315f-3926-4cf2-af77-f0f7eeaed52d {{(pid=82989) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 20:10:07 devstack cinder-volume[82989]: INFO cinder.image.image_utils [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Converted 1024.00 MB image at 573.28 MB/s Apr 15 20:10:07 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5af5315f-3926-4cf2-af77-f0f7eeaed52d is being set with open permissions: ugo+rw: NotImplementedError Apr 15 20:10:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5af5315f-3926-4cf2-af77-f0f7eeaed52d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:07 devstack sudo[87629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5af5315f-3926-4cf2-af77-f0f7eeaed52d Apr 15 20:10:07 devstack sudo[87629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:08 devstack sudo[87629]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5af5315f-3926-4cf2-af77-f0f7eeaed52d" returned: 0 in 0.399s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:08 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-5af5315f-3926-4cf2-af77-f0f7eeaed52d" released by "_copy_volume_from_snapshot" :: held 3.743s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:08 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-8aff695a-de70-4e24-9c4a-2731c331d0c6-5af5315f-3926-4cf2-af77-f0f7eeaed52d" released by "_create_volume_from_snapshot" :: held 3.768s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.792s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.644s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:08 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1288115453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8cae311-f383-471c-9da0-aff91949cd2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875a67dd2dd847be9906f3271ee20876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:02Z,use_quota=True,user_id='eafbc1aaf15f4c7498547e8789e92faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:10:08 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Creating volume c8cae311-f383-471c-9da0-aff91949cd2a {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:10:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:08 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:08 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:08 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:10:08 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:10:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c8cae311-f383-471c-9da0-aff91949cd2a 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:08 devstack sudo[87632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c8cae311-f383-471c-9da0-aff91949cd2a 1073741824 Apr 15 20:10:08 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:08 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-fe7803ce-7911-4ad2-8b5d-26ec674667f1 tempest-GroupSnapshotsTest-57414795 None] Create group from source-snapshot-68e93c79-4b8d-4e3c-98c8-bed8197fd0f3 completed successfully. Apr 15 20:10:08 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c8cae311-f383-471c-9da0-aff91949cd2a 1073741824" returned: 0 in 0.495s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c8cae311-f383-471c-9da0-aff91949cd2a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:08 devstack sudo[87671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c8cae311-f383-471c-9da0-aff91949cd2a Apr 15 20:10:08 devstack sudo[87671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:09 devstack sudo[87671]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c8cae311-f383-471c-9da0-aff91949cd2a" returned: 0 in 0.390s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.017s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "cinder-quobyte-1c7406d0-9b76-4c1b-bc81-1bee469e4889-eea781f8-55e3-4094-9c13-c908a7147ff6" by "_create_volume_from_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055146b1-d5d8-4d06-a1f9-adb46d7e4d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8cae311-f383-471c-9da0-aff91949cd2a', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c2cf31-c0cc-47a7-b89e-b20bfd0471b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-quobyte-1c7406d0-9b76-4c1b-bc81-1bee469e4889-eea781f8-55e3-4094-9c13-c908a7147ff6" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Creating volume eea781f8-55e3-4094-9c13-c908a7147ff6 from snapshot 1c7406d0-9b76-4c1b-bc81-1bee469e4889 {{(pid=82989) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "cinder-quobyte-eea781f8-55e3-4094-9c13-c908a7147ff6" by "_copy_volume_from_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-quobyte-eea781f8-55e3-4094-9c13-c908a7147ff6" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] snapshot: 1c7406d0-9b76-4c1b-bc81-1bee469e4889, volume: eea781f8-55e3-4094-9c13-c908a7147ff6, {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 20:10:09 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Volume volume-c8cae311-f383-471c-9da0-aff91949cd2a (c8cae311-f383-471c-9da0-aff91949cd2a): created successfully Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c2cf31-c0cc-47a7-b89e-b20bfd0471b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Flow 'volume_create_manager' (ae3a2383-8642-491d-829b-f01b7fdd5eed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:09 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-66464070-168b-4d56-b12a-feecdeed35cc tempest-VolumesListAdminTestJSON-409923043 None] Created volume successfully. Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[582b8289-27fd-4bb6-88be-1a8ae96d8758]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.1c7406d0-9b76-4c1b-bc81-1bee469e4889 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:09 devstack sudo[87674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.1c7406d0-9b76-4c1b-bc81-1bee469e4889 Apr 15 20:10:09 devstack sudo[87674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-539bf2b3-8cfe-4b38-8457-cb691f60635e tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "cinder-quobyte-5af5315f-3926-4cf2-af77-f0f7eeaed52d" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-539bf2b3-8cfe-4b38-8457-cb691f60635e tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-5af5315f-3926-4cf2-af77-f0f7eeaed52d" acquired by "delete_volume" :: waited 0.013s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[74112930-a8bc-4657-94e5-97be6a4626bf]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-539bf2b3-8cfe-4b38-8457-cb691f60635e tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5af5315f-3926-4cf2-af77-f0f7eeaed52d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:09 devstack sudo[87676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5af5315f-3926-4cf2-af77-f0f7eeaed52d Apr 15 20:10:09 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:09 devstack sudo[87674]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.1c7406d0-9b76-4c1b-bc81-1bee469e4889" returned: 0 in 0.598s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Creating direct copy from snapshot {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[adff9bce-8594-47b3-bc86-bffc6707d271]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:09 devstack sudo[87681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 Apr 15 20:10:09 devstack sudo[87681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:10 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-539bf2b3-8cfe-4b38-8457-cb691f60635e tempest-GroupSnapshotsTest-57414795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5af5315f-3926-4cf2-af77-f0f7eeaed52d" returned: 0 in 0.638s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-539bf2b3-8cfe-4b38-8457-cb691f60635e tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5af5315f-3926-4cf2-af77-f0f7eeaed52d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:10 devstack sudo[87687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5af5315f-3926-4cf2-af77-f0f7eeaed52d Apr 15 20:10:10 devstack sudo[87687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:10 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:10:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Flow 'volume_create_manager' (78f4f942-2372-4e70-890c-2827a0eed352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71c6b48-21c4-4846-ab10-a9c828fe292b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71c6b48-21c4-4846-ab10-a9c828fe292b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1454200905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21ea8e2-4e36-4584-aeab-e79e76858a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875a67dd2dd847be9906f3271ee20876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:10Z,use_quota=True,user_id='eafbc1aaf15f4c7498547e8789e92faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7259f4f1-0199-41de-be1f-3c8345e7d564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7259f4f1-0199-41de-be1f-3c8345e7d564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b320de5-d147-4b1b-8d17-df1f030af514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b320de5-d147-4b1b-8d17-df1f030af514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f21ea8e2-4e36-4584-aeab-e79e76858a85', 'volume_name': 'volume-f21ea8e2-4e36-4584-aeab-e79e76858a85', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f498e2-dd6e-4a90-aaf4-6f6fc2e9a2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f498e2-dd6e-4a90-aaf4-6f6fc2e9a2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15a97318-c2e1-4c0a-bc4e-3932e4648b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:10 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Volume f21ea8e2-4e36-4584-aeab-e79e76858a85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f21ea8e2-4e36-4584-aeab-e79e76858a85', 'volume_size': 1} Apr 15 20:10:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:10 devstack sudo[87681]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88" returned: 0 in 0.579s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:10 devstack cinder-volume[82989]: DEBUG cinder.utils [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Path /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eea781f8-55e3-4094-9c13-c908a7147ff6 not found in is_blk_device check {{(pid=82989) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 20:10:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eea781f8-55e3-4094-9c13-c908a7147ff6 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:10 devstack sudo[87691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eea781f8-55e3-4094-9c13-c908a7147ff6 Apr 15 20:10:10 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:10 devstack sudo[87687]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-539bf2b3-8cfe-4b38-8457-cb691f60635e tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5af5315f-3926-4cf2-af77-f0f7eeaed52d" returned: 0 in 0.485s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-539bf2b3-8cfe-4b38-8457-cb691f60635e tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-5af5315f-3926-4cf2-af77-f0f7eeaed52d" released by "delete_volume" :: held 1.150s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:10 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-539bf2b3-8cfe-4b38-8457-cb691f60635e tempest-GroupSnapshotsTest-57414795 None] Created reservations ['b4c938f4-0158-405b-ad17-8d90641f18a1'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:10 devstack cinder-volume[82989]: WARNING cinder.quota [None req-539bf2b3-8cfe-4b38-8457-cb691f60635e tempest-GroupSnapshotsTest-57414795 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1574160030 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1574160030, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:10:10 devstack cinder-volume[82989]: WARNING cinder.quota [None req-539bf2b3-8cfe-4b38-8457-cb691f60635e tempest-GroupSnapshotsTest-57414795 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1574160030 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1574160030, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:10:10 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-539bf2b3-8cfe-4b38-8457-cb691f60635e tempest-GroupSnapshotsTest-57414795 None] Created reservations ['879b8d1c-9e34-4cc6-8072-252d8a6cc971', '08483ba6-c1d0-4327-a2a4-228b2ca41efb', '37e83847-a041-4316-bffd-5072ae88e37b', '3ef44b91-7faf-4247-9086-0c174ce1217b'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-539bf2b3-8cfe-4b38-8457-cb691f60635e tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-539bf2b3-8cfe-4b38-8457-cb691f60635e tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:11 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-539bf2b3-8cfe-4b38-8457-cb691f60635e tempest-GroupSnapshotsTest-57414795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:11 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-539bf2b3-8cfe-4b38-8457-cb691f60635e tempest-GroupSnapshotsTest-57414795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-539bf2b3-8cfe-4b38-8457-cb691f60635e tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-539bf2b3-8cfe-4b38-8457-cb691f60635e tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:11 devstack sudo[87704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:10:11 devstack sudo[87704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:11 devstack sudo[87704]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-539bf2b3-8cfe-4b38-8457-cb691f60635e tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.884s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:11 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-539bf2b3-8cfe-4b38-8457-cb691f60635e tempest-GroupSnapshotsTest-57414795 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:10:11 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-539bf2b3-8cfe-4b38-8457-cb691f60635e tempest-GroupSnapshotsTest-57414795 None] Delete group completed successfully. Apr 15 20:10:11 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-6ebc8ac5-b767-4ffa-972f-7538ac2ae079 tempest-GroupSnapshotsTest-57414795 None] group_snapshot 68e93c79-4b8d-4e3c-98c8-bed8197fd0f3: deleting Apr 15 20:10:12 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-6ebc8ac5-b767-4ffa-972f-7538ac2ae079 tempest-GroupSnapshotsTest-57414795 None] group_snapshot 68e93c79-4b8d-4e3c-98c8-bed8197fd0f3: deleting {{(pid=82989) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 20:10:12 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6ebc8ac5-b767-4ffa-972f-7538ac2ae079 tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "cinder-quobyte-4d3749cc-929c-4f3f-82b5-de941b4050eb" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:12 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6ebc8ac5-b767-4ffa-972f-7538ac2ae079 tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-4d3749cc-929c-4f3f-82b5-de941b4050eb" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:12 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6ebc8ac5-b767-4ffa-972f-7538ac2ae079 tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "cinder-quobyte-8aff695a-de70-4e24-9c4a-2731c331d0c6" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:12 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6ebc8ac5-b767-4ffa-972f-7538ac2ae079 tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-8aff695a-de70-4e24-9c4a-2731c331d0c6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:12 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-6ebc8ac5-b767-4ffa-972f-7538ac2ae079 tempest-GroupSnapshotsTest-57414795 None] Deleting offline snapshot 8aff695a-de70-4e24-9c4a-2731c331d0c6 of volume 4d3749cc-929c-4f3f-82b5-de941b4050eb {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:10:12 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-6ebc8ac5-b767-4ffa-972f-7538ac2ae079 tempest-GroupSnapshotsTest-57414795 None] snapshot_file for this snap is: volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.8aff695a-de70-4e24-9c4a-2731c331d0c6 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:10:12 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[a939a6de-3922-4769-9273-639af68dbc86]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6ebc8ac5-b767-4ffa-972f-7538ac2ae079 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.8aff695a-de70-4e24-9c4a-2731c331d0c6 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:12 devstack sudo[87708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.8aff695a-de70-4e24-9c4a-2731c331d0c6 Apr 15 20:10:12 devstack sudo[87708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:12 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eea781f8-55e3-4094-9c13-c908a7147ff6" returned: 0 in 2.235s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:12 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[c578b6e8-0d85-4a2a-90c1-c9b73d847146]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:12 devstack sudo[87710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 Apr 15 20:10:12 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:12 devstack sudo[87708]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6ebc8ac5-b767-4ffa-972f-7538ac2ae079 tempest-GroupSnapshotsTest-57414795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.8aff695a-de70-4e24-9c4a-2731c331d0c6" returned: 0 in 0.807s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:12 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-6ebc8ac5-b767-4ffa-972f-7538ac2ae079 tempest-GroupSnapshotsTest-57414795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d3749cc-929c-4f3f-82b5-de941b4050eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:10:12 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e77831e-3fb7-400f-9d95-44dbf165646a]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6ebc8ac5-b767-4ffa-972f-7538ac2ae079 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:13 devstack sudo[87715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb Apr 15 20:10:13 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:13 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88" returned: 0 in 0.593s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88, size 1024.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eea781f8-55e3-4094-9c13-c908a7147ff6 {{(pid=82989) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 20:10:13 devstack cinder-volume[82989]: INFO cinder.image.image_utils [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Converted 1024.00 MB image at 457.93 MB/s Apr 15 20:10:13 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eea781f8-55e3-4094-9c13-c908a7147ff6 is being set with open permissions: ugo+rw Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eea781f8-55e3-4094-9c13-c908a7147ff6 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:13 devstack sudo[87720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eea781f8-55e3-4094-9c13-c908a7147ff6 Apr 15 20:10:13 devstack sudo[87720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:13 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6ebc8ac5-b767-4ffa-972f-7538ac2ae079 tempest-GroupSnapshotsTest-57414795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb" returned: 0 in 0.479s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6ebc8ac5-b767-4ffa-972f-7538ac2ae079 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.8aff695a-de70-4e24-9c4a-2731c331d0c6 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:13 devstack sudo[87725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.8aff695a-de70-4e24-9c4a-2731c331d0c6 Apr 15 20:10:13 devstack sudo[87725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:13 devstack sudo[87720]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eea781f8-55e3-4094-9c13-c908a7147ff6" returned: 0 in 0.413s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-quobyte-eea781f8-55e3-4094-9c13-c908a7147ff6" released by "_copy_volume_from_snapshot" :: held 4.493s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-quobyte-1c7406d0-9b76-4c1b-bc81-1bee469e4889-eea781f8-55e3-4094-9c13-c908a7147ff6" released by "_create_volume_from_snapshot" :: held 4.513s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.536s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.291s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1454200905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21ea8e2-4e36-4584-aeab-e79e76858a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875a67dd2dd847be9906f3271ee20876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:10Z,use_quota=True,user_id='eafbc1aaf15f4c7498547e8789e92faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Creating volume f21ea8e2-4e36-4584-aeab-e79e76858a85 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:10:13 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f21ea8e2-4e36-4584-aeab-e79e76858a85 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:13 devstack sudo[87728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f21ea8e2-4e36-4584-aeab-e79e76858a85 1073741824 Apr 15 20:10:13 devstack sudo[87728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20e194c-089a-4110-a0cf-201442f73002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea781f8-55e3-4094-9c13-c908a7147ff6', 'volume_size': 1, 'snapshot_id': '1c7406d0-9b76-4c1b-bc81-1bee469e4889'}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d969fc55-e760-4833-a91d-2ed1e6cca00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:13 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Volume volume-eea781f8-55e3-4094-9c13-c908a7147ff6 (eea781f8-55e3-4094-9c13-c908a7147ff6): created successfully Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d969fc55-e760-4833-a91d-2ed1e6cca00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Flow 'volume_create_manager' (a7a32f33-e9b6-46c5-97c5-103629bd7f5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:13 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-9f287f2c-4762-4b37-84f3-1c892e646fc3 tempest-VolumeDependencyTests-1373956501 None] Created volume successfully. Apr 15 20:10:13 devstack sudo[87725]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6ebc8ac5-b767-4ffa-972f-7538ac2ae079 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.8aff695a-de70-4e24-9c4a-2731c331d0c6" returned: 0 in 0.456s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6ebc8ac5-b767-4ffa-972f-7538ac2ae079 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.8aff695a-de70-4e24-9c4a-2731c331d0c6 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:13 devstack sudo[87733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.8aff695a-de70-4e24-9c4a-2731c331d0c6 Apr 15 20:10:13 devstack sudo[87733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:14 devstack sudo[87728]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f21ea8e2-4e36-4584-aeab-e79e76858a85 1073741824" returned: 0 in 0.484s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f21ea8e2-4e36-4584-aeab-e79e76858a85 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:14 devstack sudo[87738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f21ea8e2-4e36-4584-aeab-e79e76858a85 Apr 15 20:10:14 devstack sudo[87738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:14 devstack sudo[87733]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6ebc8ac5-b767-4ffa-972f-7538ac2ae079 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb.8aff695a-de70-4e24-9c4a-2731c331d0c6" returned: 0 in 0.423s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:14 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6ebc8ac5-b767-4ffa-972f-7538ac2ae079 tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-8aff695a-de70-4e24-9c4a-2731c331d0c6" released by "_delete_snapshot" :: held 2.248s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:14 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6ebc8ac5-b767-4ffa-972f-7538ac2ae079 tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-4d3749cc-929c-4f3f-82b5-de941b4050eb" released by "delete_snapshot" :: held 2.277s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:14 devstack cinder-volume[82989]: WARNING cinder.quota [None req-6ebc8ac5-b767-4ffa-972f-7538ac2ae079 tempest-GroupSnapshotsTest-57414795 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1574160030 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1574160030, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:10:14 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-6ebc8ac5-b767-4ffa-972f-7538ac2ae079 tempest-GroupSnapshotsTest-57414795 None] Created reservations ['6e3e3606-4869-45b9-927b-3fcbaa351595', 'bad69e94-25ac-4d14-aacd-27544ba51548', '5623ddac-41b1-471f-9bdd-71d936f03e01', 'a5db50a9-a88f-4ddd-9551-711db407014c'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:14 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-6ebc8ac5-b767-4ffa-972f-7538ac2ae079 tempest-GroupSnapshotsTest-57414795 None] group_snapshot 68e93c79-4b8d-4e3c-98c8-bed8197fd0f3: deleted successfully Apr 15 20:10:14 devstack sudo[87738]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f21ea8e2-4e36-4584-aeab-e79e76858a85" returned: 0 in 0.430s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:10:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15a97318-c2e1-4c0a-bc4e-3932e4648b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f21ea8e2-4e36-4584-aeab-e79e76858a85', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e12b27-afc6-4d69-9e49-3b33f087ac27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:14 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Volume volume-f21ea8e2-4e36-4584-aeab-e79e76858a85 (f21ea8e2-4e36-4584-aeab-e79e76858a85): created successfully Apr 15 20:10:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e12b27-afc6-4d69-9e49-3b33f087ac27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Flow 'volume_create_manager' (78f4f942-2372-4e70-890c-2827a0eed352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:14 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-71787b19-1334-438b-a719-a7cfdb4ce63b tempest-VolumesListAdminTestJSON-409923043 None] Created volume successfully. Apr 15 20:10:14 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-62f31d61-ef6f-4f96-ad8c-125b66d1e3b9 tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "cinder-1c7406d0-9b76-4c1b-bc81-1bee469e4889-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:14 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-62f31d61-ef6f-4f96-ad8c-125b66d1e3b9 tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-1c7406d0-9b76-4c1b-bc81-1bee469e4889-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:14 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-62f31d61-ef6f-4f96-ad8c-125b66d1e3b9 tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "cinder-quobyte-83f3ae10-a7ba-4baf-9341-54600bcd3d88" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:14 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-62f31d61-ef6f-4f96-ad8c-125b66d1e3b9 tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-quobyte-83f3ae10-a7ba-4baf-9341-54600bcd3d88" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:14 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-62f31d61-ef6f-4f96-ad8c-125b66d1e3b9 tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "cinder-quobyte-1c7406d0-9b76-4c1b-bc81-1bee469e4889" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:14 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-62f31d61-ef6f-4f96-ad8c-125b66d1e3b9 tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-quobyte-1c7406d0-9b76-4c1b-bc81-1bee469e4889" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-62f31d61-ef6f-4f96-ad8c-125b66d1e3b9 tempest-VolumeDependencyTests-1373956501 None] Deleting offline snapshot 1c7406d0-9b76-4c1b-bc81-1bee469e4889 of volume 83f3ae10-a7ba-4baf-9341-54600bcd3d88 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:10:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-62f31d61-ef6f-4f96-ad8c-125b66d1e3b9 tempest-VolumeDependencyTests-1373956501 None] snapshot_file for this snap is: volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.1c7406d0-9b76-4c1b-bc81-1bee469e4889 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:10:14 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[64de14b2-04ef-4bbc-b99e-dfb43a98ff57]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-62f31d61-ef6f-4f96-ad8c-125b66d1e3b9 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.1c7406d0-9b76-4c1b-bc81-1bee469e4889 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:14 devstack sudo[87742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.1c7406d0-9b76-4c1b-bc81-1bee469e4889 Apr 15 20:10:14 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:15 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-62f31d61-ef6f-4f96-ad8c-125b66d1e3b9 tempest-VolumeDependencyTests-1373956501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.1c7406d0-9b76-4c1b-bc81-1bee469e4889" returned: 0 in 0.455s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-62f31d61-ef6f-4f96-ad8c-125b66d1e3b9 tempest-VolumeDependencyTests-1373956501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f20f16e-9852-4a99-b6ec-c117ce048061]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-62f31d61-ef6f-4f96-ad8c-125b66d1e3b9 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:15 devstack sudo[87748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 Apr 15 20:10:15 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG dbcounter [-] [82989] Writing DB stats cinder:SELECT=145,cinder:UPDATE=193,cinder:INSERT=45,cinder:DELETE=15 {{(pid=82989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-28da8fe8-f9fd-4e5e-a18f-d8151a3020d8 tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "cinder-quobyte-4d3749cc-929c-4f3f-82b5-de941b4050eb" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-28da8fe8-f9fd-4e5e-a18f-d8151a3020d8 tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-4d3749cc-929c-4f3f-82b5-de941b4050eb" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d801de2-99bc-4b5d-a3f0-3c50119c883c]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-28da8fe8-f9fd-4e5e-a18f-d8151a3020d8 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:15 devstack sudo[87751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb Apr 15 20:10:15 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:15 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-62f31d61-ef6f-4f96-ad8c-125b66d1e3b9 tempest-VolumeDependencyTests-1373956501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88" returned: 0 in 0.539s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-62f31d61-ef6f-4f96-ad8c-125b66d1e3b9 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.1c7406d0-9b76-4c1b-bc81-1bee469e4889 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:15 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.1c7406d0-9b76-4c1b-bc81-1bee469e4889 Apr 15 20:10:15 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Flow 'volume_create_manager' (947bd85e-5e6f-49fd-b2b0-f4576cc25e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a0cb43-756b-4c6d-ab23-ed3ef6f4db4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a0cb43-756b-4c6d-ab23-ed3ef6f4db4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1264123684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=875f45e1-3e06-4f88-9105-0c1256b3aee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875a67dd2dd847be9906f3271ee20876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:16Z,use_quota=True,user_id='eafbc1aaf15f4c7498547e8789e92faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb32fa04-bbb3-48c8-a8dc-43c6391d3ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb32fa04-bbb3-48c8-a8dc-43c6391d3ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24341e8-8a82-4544-a816-9e558a1fdce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24341e8-8a82-4544-a816-9e558a1fdce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '875f45e1-3e06-4f88-9105-0c1256b3aee4', 'volume_name': 'volume-875f45e1-3e06-4f88-9105-0c1256b3aee4', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971ca72f-cfbb-43d0-875b-38af61c16c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971ca72f-cfbb-43d0-875b-38af61c16c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44443b39-4917-4d62-9ed8-c715fef1407e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:15 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Volume 875f45e1-3e06-4f88-9105-0c1256b3aee4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-875f45e1-3e06-4f88-9105-0c1256b3aee4', 'volume_size': 1} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1264123684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=875f45e1-3e06-4f88-9105-0c1256b3aee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875a67dd2dd847be9906f3271ee20876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:16Z,use_quota=True,user_id='eafbc1aaf15f4c7498547e8789e92faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Creating volume 875f45e1-3e06-4f88-9105-0c1256b3aee4 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:10:15 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-875f45e1-3e06-4f88-9105-0c1256b3aee4 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:15 devstack sudo[87761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-875f45e1-3e06-4f88-9105-0c1256b3aee4 1073741824 Apr 15 20:10:15 devstack sudo[87761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:15 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-28da8fe8-f9fd-4e5e-a18f-d8151a3020d8 tempest-GroupSnapshotsTest-57414795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb" returned: 0 in 0.509s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-28da8fe8-f9fd-4e5e-a18f-d8151a3020d8 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:16 devstack sudo[87763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb Apr 15 20:10:16 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:16 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-62f31d61-ef6f-4f96-ad8c-125b66d1e3b9 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.1c7406d0-9b76-4c1b-bc81-1bee469e4889" returned: 0 in 0.453s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-62f31d61-ef6f-4f96-ad8c-125b66d1e3b9 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.1c7406d0-9b76-4c1b-bc81-1bee469e4889 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:16 devstack sudo[87769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.1c7406d0-9b76-4c1b-bc81-1bee469e4889 Apr 15 20:10:16 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:16 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-28da8fe8-f9fd-4e5e-a18f-d8151a3020d8 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4d3749cc-929c-4f3f-82b5-de941b4050eb" returned: 0 in 0.430s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-28da8fe8-f9fd-4e5e-a18f-d8151a3020d8 tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-4d3749cc-929c-4f3f-82b5-de941b4050eb" released by "delete_volume" :: held 0.985s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:16 devstack sudo[87761]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-875f45e1-3e06-4f88-9105-0c1256b3aee4 1073741824" returned: 0 in 0.481s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-875f45e1-3e06-4f88-9105-0c1256b3aee4 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:16 devstack sudo[87774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-875f45e1-3e06-4f88-9105-0c1256b3aee4 Apr 15 20:10:16 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-28da8fe8-f9fd-4e5e-a18f-d8151a3020d8 tempest-GroupSnapshotsTest-57414795 None] Created reservations ['5ab7e0de-e4ff-4b34-b2f4-8988e0686051'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:16 devstack cinder-volume[82989]: WARNING cinder.db.sqlalchemy.api [None req-28da8fe8-f9fd-4e5e-a18f-d8151a3020d8 tempest-GroupSnapshotsTest-57414795 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1574160030'] Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-28da8fe8-f9fd-4e5e-a18f-d8151a3020d8 tempest-GroupSnapshotsTest-57414795 None] Created reservations ['3086706c-2b11-477e-8dd4-57b156942b21', '7f3854fd-e05b-4e5a-96b4-84a5ff5989bb', 'b95baeb7-19af-4b04-b9d4-d52c0f4e2de4', '11fd1708-6182-469b-bef6-74a6a26cfaab'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-28da8fe8-f9fd-4e5e-a18f-d8151a3020d8 tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-28da8fe8-f9fd-4e5e-a18f-d8151a3020d8 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-28da8fe8-f9fd-4e5e-a18f-d8151a3020d8 tempest-GroupSnapshotsTest-57414795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-28da8fe8-f9fd-4e5e-a18f-d8151a3020d8 tempest-GroupSnapshotsTest-57414795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-28da8fe8-f9fd-4e5e-a18f-d8151a3020d8 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-28da8fe8-f9fd-4e5e-a18f-d8151a3020d8 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:16 devstack sudo[87776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:10:16 devstack sudo[87776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:16 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-62f31d61-ef6f-4f96-ad8c-125b66d1e3b9 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88.1c7406d0-9b76-4c1b-bc81-1bee469e4889" returned: 0 in 0.445s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-62f31d61-ef6f-4f96-ad8c-125b66d1e3b9 tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-quobyte-1c7406d0-9b76-4c1b-bc81-1bee469e4889" released by "_delete_snapshot" :: held 1.951s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-62f31d61-ef6f-4f96-ad8c-125b66d1e3b9 tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-quobyte-83f3ae10-a7ba-4baf-9341-54600bcd3d88" released by "delete_snapshot" :: held 1.964s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-62f31d61-ef6f-4f96-ad8c-125b66d1e3b9 tempest-VolumeDependencyTests-1373956501 None] Created reservations ['49f2d550-b972-479e-a7b2-69cee01c8288', '46d40199-ca14-478c-931d-33897d0a6222', '45a3b8d8-208a-4627-ae1f-99822296fa12', '235f707a-2632-433a-92f3-9be844652764'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:16 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-62f31d61-ef6f-4f96-ad8c-125b66d1e3b9 tempest-VolumeDependencyTests-1373956501 None] Delete snapshot completed successfully. Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-62f31d61-ef6f-4f96-ad8c-125b66d1e3b9 tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-1c7406d0-9b76-4c1b-bc81-1bee469e4889-delete_snapshot" released by "delete_snapshot" :: held 2.095s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:16 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-875f45e1-3e06-4f88-9105-0c1256b3aee4" returned: 0 in 0.440s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44443b39-4917-4d62-9ed8-c715fef1407e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-875f45e1-3e06-4f88-9105-0c1256b3aee4', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f56a358-7690-40ff-a96c-eecdd763fa32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:16 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Volume volume-875f45e1-3e06-4f88-9105-0c1256b3aee4 (875f45e1-3e06-4f88-9105-0c1256b3aee4): created successfully Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f56a358-7690-40ff-a96c-eecdd763fa32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:16 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Flow 'volume_create_manager' (947bd85e-5e6f-49fd-b2b0-f4576cc25e1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:16 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-ccaf8490-06b5-462a-8c2e-e8da4237327d tempest-VolumesListAdminTestJSON-409923043 None] Created volume successfully. Apr 15 20:10:17 devstack sudo[87776]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-28da8fe8-f9fd-4e5e-a18f-d8151a3020d8 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.428s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:17 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-28da8fe8-f9fd-4e5e-a18f-d8151a3020d8 tempest-GroupSnapshotsTest-57414795 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:10:17 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-28da8fe8-f9fd-4e5e-a18f-d8151a3020d8 tempest-GroupSnapshotsTest-57414795 None] Delete group completed successfully. Apr 15 20:10:17 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-e0b871c3-af31-4b58-b9bb-e435384d1e13 tempest-GroupSnapshotsTest-57414795 None] Group tempest-GroupSnapshotsTest-Group-1892662109: creating Apr 15 20:10:17 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-e0b871c3-af31-4b58-b9bb-e435384d1e13 tempest-GroupSnapshotsTest-57414795 None] Group tempest-GroupSnapshotsTest-Group-1892662109: created successfully Apr 15 20:10:17 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-e0b871c3-af31-4b58-b9bb-e435384d1e13 tempest-GroupSnapshotsTest-57414795 None] Create group completed successfully. Apr 15 20:10:17 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9dce94a8-ebc3-464b-b67b-d87774bd29b6 tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "cinder-83f3ae10-a7ba-4baf-9341-54600bcd3d88-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:17 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9dce94a8-ebc3-464b-b67b-d87774bd29b6 tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-83f3ae10-a7ba-4baf-9341-54600bcd3d88-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:17 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9dce94a8-ebc3-464b-b67b-d87774bd29b6 tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "cinder-quobyte-83f3ae10-a7ba-4baf-9341-54600bcd3d88" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:17 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9dce94a8-ebc3-464b-b67b-d87774bd29b6 tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-quobyte-83f3ae10-a7ba-4baf-9341-54600bcd3d88" acquired by "delete_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[73da3f3a-ca53-4bb1-a76d-9ab29f449d23]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9dce94a8-ebc3-464b-b67b-d87774bd29b6 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:18 devstack sudo[87781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 Apr 15 20:10:18 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Flow 'volume_create_manager' (5522d418-a7ba-440f-90ec-c67688c4a47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3f11eb-0758-4362-bf46-9fa784fc90e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3f11eb-0758-4362-bf46-9fa784fc90e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8a76e50-f7fe-4e6d-a586-dd01a80cca44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c150f722d94948b39f19a08d14bbd43a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:18Z,use_quota=True,user_id='4cbd58a1c9f44005a66be157578c3c3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8d6cb2-cf05-4e4d-91df-65081254e067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8d6cb2-cf05-4e4d-91df-65081254e067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (313ba264-3ec9-4af1-a8bc-b084128e34c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (313ba264-3ec9-4af1-a8bc-b084128e34c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8a76e50-f7fe-4e6d-a586-dd01a80cca44', 'volume_name': 'volume-b8a76e50-f7fe-4e6d-a586-dd01a80cca44', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd504404-78d5-47b6-a54e-550f6a0d732a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd504404-78d5-47b6-a54e-550f6a0d732a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd680c33-3af4-4781-a38c-b82c769400bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:18 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Volume b8a76e50-f7fe-4e6d-a586-dd01a80cca44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8a76e50-f7fe-4e6d-a586-dd01a80cca44', 'volume_size': 1} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8a76e50-f7fe-4e6d-a586-dd01a80cca44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c150f722d94948b39f19a08d14bbd43a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:18Z,use_quota=True,user_id='4cbd58a1c9f44005a66be157578c3c3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Creating volume b8a76e50-f7fe-4e6d-a586-dd01a80cca44 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:10:18 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b8a76e50-f7fe-4e6d-a586-dd01a80cca44 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:18 devstack sudo[87783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b8a76e50-f7fe-4e6d-a586-dd01a80cca44 1073741824 Apr 15 20:10:18 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:18 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9dce94a8-ebc3-464b-b67b-d87774bd29b6 tempest-VolumeDependencyTests-1373956501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88" returned: 0 in 0.514s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9dce94a8-ebc3-464b-b67b-d87774bd29b6 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:18 devstack sudo[87788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88 Apr 15 20:10:18 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:18 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b8a76e50-f7fe-4e6d-a586-dd01a80cca44 1073741824" returned: 0 in 0.520s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b8a76e50-f7fe-4e6d-a586-dd01a80cca44 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:18 devstack sudo[87794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b8a76e50-f7fe-4e6d-a586-dd01a80cca44 Apr 15 20:10:18 devstack sudo[87794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:18 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9dce94a8-ebc3-464b-b67b-d87774bd29b6 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-83f3ae10-a7ba-4baf-9341-54600bcd3d88" returned: 0 in 0.469s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9dce94a8-ebc3-464b-b67b-d87774bd29b6 tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-quobyte-83f3ae10-a7ba-4baf-9341-54600bcd3d88" released by "delete_volume" :: held 1.016s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-9dce94a8-ebc3-464b-b67b-d87774bd29b6 tempest-VolumeDependencyTests-1373956501 None] Created reservations ['6f148f59-ab30-48fd-b52f-976ce423f0a3', '0aa62e71-0bc3-4b4c-9f5b-c6774e3db3be', 'f2a3bb15-0fb5-4cf7-986b-21874f4e0ea2', '830e7497-4d93-45d4-aa9f-938d42896ac7'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9dce94a8-ebc3-464b-b67b-d87774bd29b6 tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9dce94a8-ebc3-464b-b67b-d87774bd29b6 tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9dce94a8-ebc3-464b-b67b-d87774bd29b6 tempest-VolumeDependencyTests-1373956501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9dce94a8-ebc3-464b-b67b-d87774bd29b6 tempest-VolumeDependencyTests-1373956501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9dce94a8-ebc3-464b-b67b-d87774bd29b6 tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9dce94a8-ebc3-464b-b67b-d87774bd29b6 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:19 devstack sudo[87796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:10:19 devstack sudo[87796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Flow 'volume_create_manager' (403922bc-1323-4bdf-9e9a-84b4985fb821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d412bf-867d-4bef-99bf-e2cf8924714b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d412bf-867d-4bef-99bf-e2cf8924714b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-562708935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8cc64d66-f36d-4fdf-b8e7-31df32a1b50f,host='devstack@QuobyteHD#QuobyteHD',id=58d3aa30-d758-4d68-b4fc-9316dba98611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2478e26b98964590aaa0437bc826fd28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:19Z,use_quota=True,user_id='a471c8f5d63048458961f9b21a24a704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54877784-4183-4311-9dfe-e26aca57a09a),volume_type_id=54877784-4183-4311-9dfe-e26aca57a09a)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6065e7e2-5942-4b62-972f-7c962fd0332f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6065e7e2-5942-4b62-972f-7c962fd0332f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d826a3e6-2f1e-4b74-8122-cb5321366e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d826a3e6-2f1e-4b74-8122-cb5321366e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58d3aa30-d758-4d68-b4fc-9316dba98611', 'volume_name': 'volume-58d3aa30-d758-4d68-b4fc-9316dba98611', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145e72de-cb92-48ec-9895-986630f866ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145e72de-cb92-48ec-9895-986630f866ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29d5142-6829-4ddf-99fd-33e9824d4cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:19 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Volume 58d3aa30-d758-4d68-b4fc-9316dba98611: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58d3aa30-d758-4d68-b4fc-9316dba98611', 'volume_size': 1} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:19 devstack sudo[87794]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b8a76e50-f7fe-4e6d-a586-dd01a80cca44" returned: 0 in 0.453s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.134s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8cc64d66-f36d-4fdf-b8e7-31df32a1b50f,created_at=2026-04-15T18:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-562708935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8cc64d66-f36d-4fdf-b8e7-31df32a1b50f,host='devstack@QuobyteHD#QuobyteHD',id=58d3aa30-d758-4d68-b4fc-9316dba98611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2478e26b98964590aaa0437bc826fd28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:19Z,use_quota=True,user_id='a471c8f5d63048458961f9b21a24a704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54877784-4183-4311-9dfe-e26aca57a09a),volume_type_id=54877784-4183-4311-9dfe-e26aca57a09a)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Creating volume 58d3aa30-d758-4d68-b4fc-9316dba98611 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:10:19 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd680c33-3af4-4781-a38c-b82c769400bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8a76e50-f7fe-4e6d-a586-dd01a80cca44', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f8483d-cfba-4072-9f9c-1419266c2e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:19 devstack sudo[87799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611 1073741824 Apr 15 20:10:19 devstack sudo[87799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:19 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Volume volume-b8a76e50-f7fe-4e6d-a586-dd01a80cca44 (b8a76e50-f7fe-4e6d-a586-dd01a80cca44): created successfully Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f8483d-cfba-4072-9f9c-1419266c2e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Flow 'volume_create_manager' (5522d418-a7ba-440f-90ec-c67688c4a47c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:19 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-293e76d5-589d-4fed-99a7-149174c093c3 tempest-VolumesListAdminTestJSON-1190867740 None] Created volume successfully. Apr 15 20:10:19 devstack sudo[87796]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9dce94a8-ebc3-464b-b67b-d87774bd29b6 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.447s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-9dce94a8-ebc3-464b-b67b-d87774bd29b6 tempest-VolumeDependencyTests-1373956501 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:10:19 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-9dce94a8-ebc3-464b-b67b-d87774bd29b6 tempest-VolumeDependencyTests-1373956501 None] Deleted volume successfully. Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-9dce94a8-ebc3-464b-b67b-d87774bd29b6 tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-83f3ae10-a7ba-4baf-9341-54600bcd3d88-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:19 devstack sudo[87799]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611 1073741824" returned: 0 in 0.496s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:19 devstack sudo[87805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611 Apr 15 20:10:19 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Flow 'volume_create_manager' (05e3e781-3a96-45b2-86aa-3f8320662b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286af2bf-46b0-48d7-9736-fea4a16cb005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286af2bf-46b0-48d7-9736-fea4a16cb005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1316561687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f61b0d-d009-42e6-a03d-14bda6709a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5510f5d10ce495d99b71244226a8809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:20Z,use_quota=True,user_id='b4f58d540ae147f1bc8a6b946ff3b330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:20 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9773c17e-d0cb-4fb8-b766-1a61c22b7027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9773c17e-d0cb-4fb8-b766-1a61c22b7027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060848e8-ab6e-4618-a135-e169439b2101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060848e8-ab6e-4618-a135-e169439b2101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2f61b0d-d009-42e6-a03d-14bda6709a00', 'volume_name': 'volume-f2f61b0d-d009-42e6-a03d-14bda6709a00', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d982f52-6e95-4c24-b1a2-fcc6fc2990f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d982f52-6e95-4c24-b1a2-fcc6fc2990f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cae722f-db4c-472c-b69b-a0be08b597ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:20 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Volume f2f61b0d-d009-42e6-a03d-14bda6709a00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2f61b0d-d009-42e6-a03d-14bda6709a00', 'volume_size': 1} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611" returned: 0 in 0.485s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1316561687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f61b0d-d009-42e6-a03d-14bda6709a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5510f5d10ce495d99b71244226a8809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:20Z,use_quota=True,user_id='b4f58d540ae147f1bc8a6b946ff3b330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Creating volume f2f61b0d-d009-42e6-a03d-14bda6709a00 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:10:20 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29d5142-6829-4ddf-99fd-33e9824d4cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58d3aa30-d758-4d68-b4fc-9316dba98611', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:20 devstack sudo[87808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 1073741824 Apr 15 20:10:20 devstack sudo[87808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e1508bb-4e78-4f27-b296-361e4372c395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:20 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Volume volume-58d3aa30-d758-4d68-b4fc-9316dba98611 (58d3aa30-d758-4d68-b4fc-9316dba98611): created successfully Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e1508bb-4e78-4f27-b296-361e4372c395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Flow 'volume_create_manager' (403922bc-1323-4bdf-9e9a-84b4985fb821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:20 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-38d5012e-953e-46f8-99e4-36351ca2a9d9 tempest-GroupSnapshotsTest-57414795 None] Created volume successfully. Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-414b7921-27a7-43fc-9147-cf567fef73f2 tempest-VolumesListAdminTestJSON-1190867740 None] Acquiring lock "cinder-b8a76e50-f7fe-4e6d-a586-dd01a80cca44-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-414b7921-27a7-43fc-9147-cf567fef73f2 tempest-VolumesListAdminTestJSON-1190867740 None] Lock "cinder-b8a76e50-f7fe-4e6d-a586-dd01a80cca44-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-414b7921-27a7-43fc-9147-cf567fef73f2 tempest-VolumesListAdminTestJSON-1190867740 None] Acquiring lock "cinder-quobyte-b8a76e50-f7fe-4e6d-a586-dd01a80cca44" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-414b7921-27a7-43fc-9147-cf567fef73f2 tempest-VolumesListAdminTestJSON-1190867740 None] Lock "cinder-quobyte-b8a76e50-f7fe-4e6d-a586-dd01a80cca44" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[b525fa69-b138-4ef2-8ae3-5a692dfd28ae]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-414b7921-27a7-43fc-9147-cf567fef73f2 tempest-VolumesListAdminTestJSON-1190867740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b8a76e50-f7fe-4e6d-a586-dd01a80cca44 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e1b7ba95-bbfb-493e-804c-135305eeadc2 tempest-VolumesListAdminTestJSON-409923043 None] Acquiring lock "cinder-875f45e1-3e06-4f88-9105-0c1256b3aee4-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e1b7ba95-bbfb-493e-804c-135305eeadc2 tempest-VolumesListAdminTestJSON-409923043 None] Lock "cinder-875f45e1-3e06-4f88-9105-0c1256b3aee4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:20 devstack sudo[87810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b8a76e50-f7fe-4e6d-a586-dd01a80cca44 Apr 15 20:10:20 devstack sudo[87810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e1b7ba95-bbfb-493e-804c-135305eeadc2 tempest-VolumesListAdminTestJSON-409923043 None] Acquiring lock "cinder-quobyte-875f45e1-3e06-4f88-9105-0c1256b3aee4" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e1b7ba95-bbfb-493e-804c-135305eeadc2 tempest-VolumesListAdminTestJSON-409923043 None] Lock "cinder-quobyte-875f45e1-3e06-4f88-9105-0c1256b3aee4" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93bfa90-9a01-46b7-a429-250af68c5b9f]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e1b7ba95-bbfb-493e-804c-135305eeadc2 tempest-VolumesListAdminTestJSON-409923043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-875f45e1-3e06-4f88-9105-0c1256b3aee4 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:20 devstack sudo[87812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-875f45e1-3e06-4f88-9105-0c1256b3aee4 Apr 15 20:10:20 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:20 devstack sudo[87808]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 1073741824" returned: 0 in 0.504s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:20 devstack sudo[87817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 Apr 15 20:10:20 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:21 devstack sudo[87810]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-414b7921-27a7-43fc-9147-cf567fef73f2 tempest-VolumesListAdminTestJSON-1190867740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b8a76e50-f7fe-4e6d-a586-dd01a80cca44" returned: 0 in 0.518s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-414b7921-27a7-43fc-9147-cf567fef73f2 tempest-VolumesListAdminTestJSON-1190867740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b8a76e50-f7fe-4e6d-a586-dd01a80cca44 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:21 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b8a76e50-f7fe-4e6d-a586-dd01a80cca44 Apr 15 20:10:21 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:21 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e1b7ba95-bbfb-493e-804c-135305eeadc2 tempest-VolumesListAdminTestJSON-409923043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-875f45e1-3e06-4f88-9105-0c1256b3aee4" returned: 0 in 0.504s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e1b7ba95-bbfb-493e-804c-135305eeadc2 tempest-VolumesListAdminTestJSON-409923043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-875f45e1-3e06-4f88-9105-0c1256b3aee4 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:21 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-875f45e1-3e06-4f88-9105-0c1256b3aee4 Apr 15 20:10:21 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:21 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00" returned: 0 in 0.498s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cae722f-db4c-472c-b69b-a0be08b597ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2f61b0d-d009-42e6-a03d-14bda6709a00', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d61d6c9-4f5c-4e17-9544-8240024e47ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:21 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Volume volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 (f2f61b0d-d009-42e6-a03d-14bda6709a00): created successfully Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d61d6c9-4f5c-4e17-9544-8240024e47ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Flow 'volume_create_manager' (05e3e781-3a96-45b2-86aa-3f8320662b5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:21 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-d778dfe0-324f-4033-91cb-7334b0665b0d tempest-VolumeDependencyTests-1373956501 None] Created volume successfully. Apr 15 20:10:21 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-414b7921-27a7-43fc-9147-cf567fef73f2 tempest-VolumesListAdminTestJSON-1190867740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b8a76e50-f7fe-4e6d-a586-dd01a80cca44" returned: 0 in 0.482s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-414b7921-27a7-43fc-9147-cf567fef73f2 tempest-VolumesListAdminTestJSON-1190867740 None] Lock "cinder-quobyte-b8a76e50-f7fe-4e6d-a586-dd01a80cca44" released by "delete_volume" :: held 1.039s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:21 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e1b7ba95-bbfb-493e-804c-135305eeadc2 tempest-VolumesListAdminTestJSON-409923043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-875f45e1-3e06-4f88-9105-0c1256b3aee4" returned: 0 in 0.439s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-414b7921-27a7-43fc-9147-cf567fef73f2 tempest-VolumesListAdminTestJSON-1190867740 None] Created reservations ['b6f692b2-2d33-4643-b093-ce667a267ab5', '063106e7-6204-4270-863c-61fd135be56c', '4d8fc99b-2f07-4622-b4a1-df8a25740976', 'f2b0a250-2ca8-4aa8-9d1f-2838994252c5'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e1b7ba95-bbfb-493e-804c-135305eeadc2 tempest-VolumesListAdminTestJSON-409923043 None] Lock "cinder-quobyte-875f45e1-3e06-4f88-9105-0c1256b3aee4" released by "delete_volume" :: held 1.000s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Flow 'volume_create_manager' (68d01500-c773-42ca-805d-73e82b94d721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b3c94e-a410-4047-b7e1-50a54e5cee45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b3c94e-a410-4047-b7e1-50a54e5cee45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1661055053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8cc64d66-f36d-4fdf-b8e7-31df32a1b50f,host='devstack@QuobyteHD#QuobyteHD',id=240c531f-01b1-455e-8870-f6e43e123a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2478e26b98964590aaa0437bc826fd28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:22Z,use_quota=True,user_id='a471c8f5d63048458961f9b21a24a704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54877784-4183-4311-9dfe-e26aca57a09a),volume_type_id=54877784-4183-4311-9dfe-e26aca57a09a)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5a1c2c-c91e-45dc-bb45-7b22565f85e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5a1c2c-c91e-45dc-bb45-7b22565f85e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e6ca14-623c-470c-82f7-fbb5fc7ac500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e6ca14-623c-470c-82f7-fbb5fc7ac500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '240c531f-01b1-455e-8870-f6e43e123a00', 'volume_name': 'volume-240c531f-01b1-455e-8870-f6e43e123a00', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3ea0b7-9115-4d8c-ab06-48f928fe0322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3ea0b7-9115-4d8c-ab06-48f928fe0322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1013912a-f95a-4cdd-9146-447561f274da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:21 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Volume 240c531f-01b1-455e-8870-f6e43e123a00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-240c531f-01b1-455e-8870-f6e43e123a00', 'volume_size': 1} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8cc64d66-f36d-4fdf-b8e7-31df32a1b50f,created_at=2026-04-15T18:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1661055053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8cc64d66-f36d-4fdf-b8e7-31df32a1b50f,host='devstack@QuobyteHD#QuobyteHD',id=240c531f-01b1-455e-8870-f6e43e123a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2478e26b98964590aaa0437bc826fd28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:22Z,use_quota=True,user_id='a471c8f5d63048458961f9b21a24a704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54877784-4183-4311-9dfe-e26aca57a09a),volume_type_id=54877784-4183-4311-9dfe-e26aca57a09a)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Creating volume 240c531f-01b1-455e-8870-f6e43e123a00 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:10:21 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:21 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00 1073741824 Apr 15 20:10:21 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-414b7921-27a7-43fc-9147-cf567fef73f2 tempest-VolumesListAdminTestJSON-1190867740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-414b7921-27a7-43fc-9147-cf567fef73f2 tempest-VolumesListAdminTestJSON-1190867740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-414b7921-27a7-43fc-9147-cf567fef73f2 tempest-VolumesListAdminTestJSON-1190867740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-414b7921-27a7-43fc-9147-cf567fef73f2 tempest-VolumesListAdminTestJSON-1190867740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-414b7921-27a7-43fc-9147-cf567fef73f2 tempest-VolumesListAdminTestJSON-1190867740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-414b7921-27a7-43fc-9147-cf567fef73f2 tempest-VolumesListAdminTestJSON-1190867740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-e1b7ba95-bbfb-493e-804c-135305eeadc2 tempest-VolumesListAdminTestJSON-409923043 None] Created reservations ['4996401c-e664-4fdb-83f5-83527335b66d', 'b66bcced-0dcc-45c2-a904-0f77b2317576', 'eb275dce-f253-4051-8d1e-6c836d316711', '67ef94d0-f467-452b-9baf-16bf893fabad'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:21 devstack sudo[87834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:10:21 devstack sudo[87834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e1b7ba95-bbfb-493e-804c-135305eeadc2 tempest-VolumesListAdminTestJSON-409923043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e1b7ba95-bbfb-493e-804c-135305eeadc2 tempest-VolumesListAdminTestJSON-409923043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e1b7ba95-bbfb-493e-804c-135305eeadc2 tempest-VolumesListAdminTestJSON-409923043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e1b7ba95-bbfb-493e-804c-135305eeadc2 tempest-VolumesListAdminTestJSON-409923043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e1b7ba95-bbfb-493e-804c-135305eeadc2 tempest-VolumesListAdminTestJSON-409923043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e1b7ba95-bbfb-493e-804c-135305eeadc2 tempest-VolumesListAdminTestJSON-409923043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:21 devstack sudo[87836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:10:21 devstack sudo[87836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:22 devstack sudo[87834]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-414b7921-27a7-43fc-9147-cf567fef73f2 tempest-VolumesListAdminTestJSON-1190867740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.423s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-414b7921-27a7-43fc-9147-cf567fef73f2 tempest-VolumesListAdminTestJSON-1190867740 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:10:22 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-414b7921-27a7-43fc-9147-cf567fef73f2 tempest-VolumesListAdminTestJSON-1190867740 None] Deleted volume successfully. Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-414b7921-27a7-43fc-9147-cf567fef73f2 tempest-VolumesListAdminTestJSON-1190867740 None] Lock "cinder-b8a76e50-f7fe-4e6d-a586-dd01a80cca44-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:22 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00 1073741824" returned: 0 in 0.487s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:22 devstack sudo[87836]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e1b7ba95-bbfb-493e-804c-135305eeadc2 tempest-VolumesListAdminTestJSON-409923043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.430s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-e1b7ba95-bbfb-493e-804c-135305eeadc2 tempest-VolumesListAdminTestJSON-409923043 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:10:22 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-e1b7ba95-bbfb-493e-804c-135305eeadc2 tempest-VolumesListAdminTestJSON-409923043 None] Deleted volume successfully. Apr 15 20:10:22 devstack sudo[87844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00 Apr 15 20:10:22 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e1b7ba95-bbfb-493e-804c-135305eeadc2 tempest-VolumesListAdminTestJSON-409923043 None] Lock "cinder-875f45e1-3e06-4f88-9105-0c1256b3aee4-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Flow 'volume_create_manager' (2477866b-9b72-42a8-aea3-fdd1ce7e7321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c268ca-bf25-461c-89dc-66e19add0e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c268ca-bf25-461c-89dc-66e19add0e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-846715497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6927b55d-8af0-40b3-822b-7ad8dd90bd0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5510f5d10ce495d99b71244226a8809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f2f61b0d-d009-42e6-a03d-14bda6709a00,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:23Z,use_quota=True,user_id='b4f58d540ae147f1bc8a6b946ff3b330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a017fc50-418a-4726-a642-095f2544bc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a017fc50-418a-4726-a642-095f2544bc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c5462c-0bd4-43b2-9d7f-e06f864d2b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:22 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00" returned: 0 in 0.482s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c5462c-0bd4-43b2-9d7f-e06f864d2b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6927b55d-8af0-40b3-822b-7ad8dd90bd0a', 'volume_name': 'volume-6927b55d-8af0-40b3-822b-7ad8dd90bd0a', 'volume_size': 1, 'source_volid': 'f2f61b0d-d009-42e6-a03d-14bda6709a00', 'source_volstatus': 'available'}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9834655-d916-4779-8d43-f9adbd99c56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9834655-d916-4779-8d43-f9adbd99c56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3adebbf-d296-4dcc-a3e2-30ad13f82ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:22 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Volume 6927b55d-8af0-40b3-822b-7ad8dd90bd0a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6927b55d-8af0-40b3-822b-7ad8dd90bd0a', 'volume_size': 1, 'source_volid': 'f2f61b0d-d009-42e6-a03d-14bda6709a00', 'source_volstatus': 'available'} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1013912a-f95a-4cdd-9146-447561f274da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-240c531f-01b1-455e-8870-f6e43e123a00', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e7ea1d-7fa2-4b0a-a938-99506e63af50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:22 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Cloning volume f2f61b0d-d009-42e6-a03d-14bda6709a00 to volume 6927b55d-8af0-40b3-822b-7ad8dd90bd0a Apr 15 20:10:22 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Volume volume-240c531f-01b1-455e-8870-f6e43e123a00 (240c531f-01b1-455e-8870-f6e43e123a00): created successfully Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e7ea1d-7fa2-4b0a-a938-99506e63af50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Flow 'volume_create_manager' (68d01500-c773-42ca-805d-73e82b94d721) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:22 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-02ee5b5d-aa19-469c-b8b7-b9ad3829bbc2 tempest-GroupSnapshotsTest-57414795 None] Created volume successfully. Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3aca75f1-3cfb-41e7-bbd8-731863418161 tempest-VolumesListAdminTestJSON-409923043 None] Acquiring lock "cinder-f21ea8e2-4e36-4584-aeab-e79e76858a85-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Creating offline snapshot 2052d0fc-dd89-4cac-a904-f7b9fc8d119d of volume f2f61b0d-d009-42e6-a03d-14bda6709a00 {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed56a6d-d481-4e99-b6cf-70a486ba3d84]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3aca75f1-3cfb-41e7-bbd8-731863418161 tempest-VolumesListAdminTestJSON-409923043 None] Lock "cinder-f21ea8e2-4e36-4584-aeab-e79e76858a85-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3aca75f1-3cfb-41e7-bbd8-731863418161 tempest-VolumesListAdminTestJSON-409923043 None] Acquiring lock "cinder-quobyte-f21ea8e2-4e36-4584-aeab-e79e76858a85" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3aca75f1-3cfb-41e7-bbd8-731863418161 tempest-VolumesListAdminTestJSON-409923043 None] Lock "cinder-quobyte-f21ea8e2-4e36-4584-aeab-e79e76858a85" acquired by "delete_volume" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[404aeefa-b46d-421a-af08-c6be0304bcf7]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3aca75f1-3cfb-41e7-bbd8-731863418161 tempest-VolumesListAdminTestJSON-409923043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f21ea8e2-4e36-4584-aeab-e79e76858a85 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:22 devstack sudo[87847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 Apr 15 20:10:22 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:23 devstack sudo[87848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f21ea8e2-4e36-4584-aeab-e79e76858a85 Apr 15 20:10:23 devstack sudo[87848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:23 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00" returned: 0 in 0.458s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.2052d0fc-dd89-4cac-a904-f7b9fc8d119d 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:23 devstack sudo[87857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.2052d0fc-dd89-4cac-a904-f7b9fc8d119d 1G Apr 15 20:10:23 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:23 devstack sudo[87848]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3aca75f1-3cfb-41e7-bbd8-731863418161 tempest-VolumesListAdminTestJSON-409923043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f21ea8e2-4e36-4584-aeab-e79e76858a85" returned: 0 in 0.453s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3aca75f1-3cfb-41e7-bbd8-731863418161 tempest-VolumesListAdminTestJSON-409923043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f21ea8e2-4e36-4584-aeab-e79e76858a85 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:23 devstack sudo[87859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f21ea8e2-4e36-4584-aeab-e79e76858a85 Apr 15 20:10:23 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:23 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3aca75f1-3cfb-41e7-bbd8-731863418161 tempest-VolumesListAdminTestJSON-409923043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f21ea8e2-4e36-4584-aeab-e79e76858a85" returned: 0 in 0.447s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:23 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3aca75f1-3cfb-41e7-bbd8-731863418161 tempest-VolumesListAdminTestJSON-409923043 None] Lock "cinder-quobyte-f21ea8e2-4e36-4584-aeab-e79e76858a85" released by "delete_volume" :: held 0.922s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:23 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.2052d0fc-dd89-4cac-a904-f7b9fc8d119d 1G" returned: 0 in 0.523s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.2052d0fc-dd89-4cac-a904-f7b9fc8d119d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:23 devstack sudo[87865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.2052d0fc-dd89-4cac-a904-f7b9fc8d119d Apr 15 20:10:23 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:23 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-3aca75f1-3cfb-41e7-bbd8-731863418161 tempest-VolumesListAdminTestJSON-409923043 None] Created reservations ['5416c6a1-9ead-4708-b576-794f89cb8ebb', '5f767618-1ac0-4bed-a874-41d2ea932154', '8248d23b-9c7a-43cb-aee4-30872a758b0e', '9dd2a57e-8aef-452a-bac0-b0843e434724'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:23 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-8db63d54-f564-457a-a0a2-4a6b5a046a43 tempest-GroupSnapshotsTest-57414795 None] Update group completed successfully. Apr 15 20:10:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3aca75f1-3cfb-41e7-bbd8-731863418161 tempest-VolumesListAdminTestJSON-409923043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3aca75f1-3cfb-41e7-bbd8-731863418161 tempest-VolumesListAdminTestJSON-409923043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3aca75f1-3cfb-41e7-bbd8-731863418161 tempest-VolumesListAdminTestJSON-409923043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3aca75f1-3cfb-41e7-bbd8-731863418161 tempest-VolumesListAdminTestJSON-409923043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3aca75f1-3cfb-41e7-bbd8-731863418161 tempest-VolumesListAdminTestJSON-409923043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3aca75f1-3cfb-41e7-bbd8-731863418161 tempest-VolumesListAdminTestJSON-409923043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:24 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:10:24 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:24 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.2052d0fc-dd89-4cac-a904-f7b9fc8d119d" returned: 0 in 0.428s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:24 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.2052d0fc-dd89-4cac-a904-f7b9fc8d119d is being set with open permissions: ugo+rw Apr 15 20:10:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.2052d0fc-dd89-4cac-a904-f7b9fc8d119d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:24 devstack sudo[87872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.2052d0fc-dd89-4cac-a904-f7b9fc8d119d Apr 15 20:10:24 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:24 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3aca75f1-3cfb-41e7-bbd8-731863418161 tempest-VolumesListAdminTestJSON-409923043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.403s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:24 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-3aca75f1-3cfb-41e7-bbd8-731863418161 tempest-VolumesListAdminTestJSON-409923043 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:10:24 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-3aca75f1-3cfb-41e7-bbd8-731863418161 tempest-VolumesListAdminTestJSON-409923043 None] Deleted volume successfully. Apr 15 20:10:24 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3aca75f1-3cfb-41e7-bbd8-731863418161 tempest-VolumesListAdminTestJSON-409923043 None] Lock "cinder-f21ea8e2-4e36-4584-aeab-e79e76858a85-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:24 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.2052d0fc-dd89-4cac-a904-f7b9fc8d119d" returned: 0 in 0.405s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:24 devstack sudo[87877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.info Apr 15 20:10:24 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:25 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-ea4317ca-b7a9-4109-9467-038c56bdf9f4 tempest-GroupSnapshotsTest-57414795 None] Update group completed successfully. Apr 15 20:10:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dbba1d66-f234-48de-99bc-7d9e2096c8f1 tempest-VolumesListAdminTestJSON-409923043 None] Acquiring lock "cinder-c8cae311-f383-471c-9da0-aff91949cd2a-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dbba1d66-f234-48de-99bc-7d9e2096c8f1 tempest-VolumesListAdminTestJSON-409923043 None] Lock "cinder-c8cae311-f383-471c-9da0-aff91949cd2a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dbba1d66-f234-48de-99bc-7d9e2096c8f1 tempest-VolumesListAdminTestJSON-409923043 None] Acquiring lock "cinder-quobyte-c8cae311-f383-471c-9da0-aff91949cd2a" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dbba1d66-f234-48de-99bc-7d9e2096c8f1 tempest-VolumesListAdminTestJSON-409923043 None] Lock "cinder-quobyte-c8cae311-f383-471c-9da0-aff91949cd2a" acquired by "delete_volume" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:25 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cb3ad1-6b34-4983-b9dd-bde9b8379346]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dbba1d66-f234-48de-99bc-7d9e2096c8f1 tempest-VolumesListAdminTestJSON-409923043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c8cae311-f383-471c-9da0-aff91949cd2a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:25 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.info" returned: 0 in 0.445s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:25 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.info is being set with open permissions: ugo+rw Apr 15 20:10:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:25 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.info Apr 15 20:10:25 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:25 devstack sudo[87880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c8cae311-f383-471c-9da0-aff91949cd2a Apr 15 20:10:25 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:25 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.info" returned: 0 in 0.398s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "cinder-quobyte-6927b55d-8af0-40b3-822b-7ad8dd90bd0a" by "_copy_volume_from_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-quobyte-6927b55d-8af0-40b3-822b-7ad8dd90bd0a" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:25 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] snapshot: 2052d0fc-dd89-4cac-a904-f7b9fc8d119d, volume: 6927b55d-8af0-40b3-822b-7ad8dd90bd0a, {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 20:10:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:25 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:25 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:25 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d119bf-fcf8-4d90-8109-431eb280b38f]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.2052d0fc-dd89-4cac-a904-f7b9fc8d119d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:25 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dbba1d66-f234-48de-99bc-7d9e2096c8f1 tempest-VolumesListAdminTestJSON-409923043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c8cae311-f383-471c-9da0-aff91949cd2a" returned: 0 in 0.482s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dbba1d66-f234-48de-99bc-7d9e2096c8f1 tempest-VolumesListAdminTestJSON-409923043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c8cae311-f383-471c-9da0-aff91949cd2a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:25 devstack sudo[87889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c8cae311-f383-471c-9da0-aff91949cd2a Apr 15 20:10:25 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:25 devstack sudo[87888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.2052d0fc-dd89-4cac-a904-f7b9fc8d119d Apr 15 20:10:25 devstack sudo[87888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:26 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dbba1d66-f234-48de-99bc-7d9e2096c8f1 tempest-VolumesListAdminTestJSON-409923043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c8cae311-f383-471c-9da0-aff91949cd2a" returned: 0 in 0.392s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:26 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dbba1d66-f234-48de-99bc-7d9e2096c8f1 tempest-VolumesListAdminTestJSON-409923043 None] Lock "cinder-quobyte-c8cae311-f383-471c-9da0-aff91949cd2a" released by "delete_volume" :: held 0.904s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:26 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-dbba1d66-f234-48de-99bc-7d9e2096c8f1 tempest-VolumesListAdminTestJSON-409923043 None] Created reservations ['f96e4caa-dad3-4dce-9693-e18589e10dfb', 'e3034aa0-8f13-4738-adb4-a59d7de0b752', '31b4506c-c296-488d-a100-9e44d55a3dfd', 'e23388c7-2d99-430a-bd93-eedbe5d0125f'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:26 devstack sudo[87888]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.2052d0fc-dd89-4cac-a904-f7b9fc8d119d" returned: 0 in 0.493s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:26 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2f61b0d-d009-42e6-a03d-14bda6709a00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:10:26 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 20:10:26 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Creating direct copy from snapshot {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 20:10:26 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd966fda-ef8d-44b0-870b-bc2fd1e0553a]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dbba1d66-f234-48de-99bc-7d9e2096c8f1 tempest-VolumesListAdminTestJSON-409923043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dbba1d66-f234-48de-99bc-7d9e2096c8f1 tempest-VolumesListAdminTestJSON-409923043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:26 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-dbba1d66-f234-48de-99bc-7d9e2096c8f1 tempest-VolumesListAdminTestJSON-409923043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:26 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-dbba1d66-f234-48de-99bc-7d9e2096c8f1 tempest-VolumesListAdminTestJSON-409923043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dbba1d66-f234-48de-99bc-7d9e2096c8f1 tempest-VolumesListAdminTestJSON-409923043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dbba1d66-f234-48de-99bc-7d9e2096c8f1 tempest-VolumesListAdminTestJSON-409923043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:26 devstack sudo[87897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:10:26 devstack sudo[87897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:26 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-6fb135f7-c1e0-47f1-8516-ccc9e842d28f tempest-GroupSnapshotsTest-57414795 None] Update group completed successfully. Apr 15 20:10:26 devstack sudo[87896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 Apr 15 20:10:26 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:26 devstack sudo[87897]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dbba1d66-f234-48de-99bc-7d9e2096c8f1 tempest-VolumesListAdminTestJSON-409923043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.455s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:26 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-dbba1d66-f234-48de-99bc-7d9e2096c8f1 tempest-VolumesListAdminTestJSON-409923043 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:10:26 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-dbba1d66-f234-48de-99bc-7d9e2096c8f1 tempest-VolumesListAdminTestJSON-409923043 None] Deleted volume successfully. Apr 15 20:10:26 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dbba1d66-f234-48de-99bc-7d9e2096c8f1 tempest-VolumesListAdminTestJSON-409923043 None] Lock "cinder-c8cae311-f383-471c-9da0-aff91949cd2a-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:26 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00" returned: 0 in 0.531s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:26 devstack cinder-volume[82989]: DEBUG cinder.utils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Path /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6927b55d-8af0-40b3-822b-7ad8dd90bd0a not found in is_blk_device check {{(pid=82989) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 20:10:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6927b55d-8af0-40b3-822b-7ad8dd90bd0a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:26 devstack sudo[87904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6927b55d-8af0-40b3-822b-7ad8dd90bd0a Apr 15 20:10:26 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:27 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-bd9d8f79-cdde-4402-803e-dbf0b1868a13 tempest-GroupSnapshotsTest-57414795 None] Update group completed successfully. Apr 15 20:10:27 devstack cinder-volume[82989]: DEBUG oslo_service.periodic_task [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82989) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 20:10:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:27 devstack sudo[87916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:10:27 devstack sudo[87916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:28 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6927b55d-8af0-40b3-822b-7ad8dd90bd0a" returned: 0 in 2.185s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:28 devstack sudo[87916]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:28 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[205ff3e2-2225-467d-bc79-1d199b048c9a]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 1.211s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:28 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:10:28 devstack sudo[87919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 Apr 15 20:10:28 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:28 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] GroupSnapshot ec9b6b82-6291-4ed8-83eb-b4b391ee906f: creating. Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] Group snapshot ec9b6b82-6291-4ed8-83eb-b4b391ee906f: creating. {{(pid=82989) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:29 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00" returned: 0 in 0.630s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00, size 1024.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6927b55d-8af0-40b3-822b-7ad8dd90bd0a {{(pid=82989) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 20:10:29 devstack cinder-volume[82989]: INFO cinder.image.image_utils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Converted 1024.00 MB image at 468.49 MB/s Apr 15 20:10:29 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6927b55d-8af0-40b3-822b-7ad8dd90bd0a is being set with open permissions: ugo+rw Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6927b55d-8af0-40b3-822b-7ad8dd90bd0a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:29 devstack sudo[87924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6927b55d-8af0-40b3-822b-7ad8dd90bd0a Apr 15 20:10:29 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Flow 'volume_create_manager' (b804b45a-fa8e-458e-9fd9-5c7f07afbf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ab02d6-bfc5-49da-bf63-475fd9a9e0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ab02d6-bfc5-49da-bf63-475fd9a9e0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1267626454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f372803d-ffc3-419e-b5ba-b7daab220e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1d5a7ff97f4bdfbee64c0c0f1ebc9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:30Z,use_quota=True,user_id='13dc60bb0adb445b837963f0956ea59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52a8f28-a6d7-4bff-928e-dd5489fb5f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52a8f28-a6d7-4bff-928e-dd5489fb5f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87edcc6c-bd9d-4431-acbf-7784342c8cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87edcc6c-bd9d-4431-acbf-7784342c8cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f372803d-ffc3-419e-b5ba-b7daab220e9f', 'volume_name': 'volume-f372803d-ffc3-419e-b5ba-b7daab220e9f', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4cf650-11ac-4c3f-913f-08a94f273fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4cf650-11ac-4c3f-913f-08a94f273fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54ed481-ef35-42af-896a-cb15a42bb692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:29 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Volume f372803d-ffc3-419e-b5ba-b7daab220e9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f372803d-ffc3-419e-b5ba-b7daab220e9f', 'volume_size': 1} Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:29 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6927b55d-8af0-40b3-822b-7ad8dd90bd0a" returned: 0 in 0.413s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-quobyte-6927b55d-8af0-40b3-822b-7ad8dd90bd0a" released by "_copy_volume_from_snapshot" :: held 4.309s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "cinder-quobyte-2052d0fc-dd89-4cac-a904-f7b9fc8d119d" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-quobyte-2052d0fc-dd89-4cac-a904-f7b9fc8d119d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Deleting offline snapshot 2052d0fc-dd89-4cac-a904-f7b9fc8d119d of volume f2f61b0d-d009-42e6-a03d-14bda6709a00 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] snapshot_file for this snap is: volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.2052d0fc-dd89-4cac-a904-f7b9fc8d119d {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[8720287c-3cd0-4e85-902d-f154380b13fb]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.2052d0fc-dd89-4cac-a904-f7b9fc8d119d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:29 devstack sudo[87927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.2052d0fc-dd89-4cac-a904-f7b9fc8d119d Apr 15 20:10:29 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:30 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.2052d0fc-dd89-4cac-a904-f7b9fc8d119d" returned: 0 in 0.445s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2f61b0d-d009-42e6-a03d-14bda6709a00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:10:30 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdc10ec-ce04-4fd7-a439-408b3099d87a]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:30 devstack sudo[87932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 Apr 15 20:10:30 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:30 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00" returned: 0 in 0.461s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.2052d0fc-dd89-4cac-a904-f7b9fc8d119d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:30 devstack sudo[87937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.2052d0fc-dd89-4cac-a904-f7b9fc8d119d Apr 15 20:10:30 devstack sudo[87937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:31 devstack sudo[87937]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.2052d0fc-dd89-4cac-a904-f7b9fc8d119d" returned: 0 in 0.455s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.2052d0fc-dd89-4cac-a904-f7b9fc8d119d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:31 devstack sudo[87943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.2052d0fc-dd89-4cac-a904-f7b9fc8d119d Apr 15 20:10:31 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:31 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00.2052d0fc-dd89-4cac-a904-f7b9fc8d119d" returned: 0 in 0.391s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:31 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-quobyte-2052d0fc-dd89-4cac-a904-f7b9fc8d119d" released by "_delete_snapshot" :: held 1.801s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:31 devstack cinder-volume[82989]: DEBUG dbcounter [-] [82989] Writing DB stats cinder:SELECT=194,cinder:UPDATE=220,cinder:DELETE=21,cinder:INSERT=53 {{(pid=82989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:10:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.903s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.732s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:31 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] Creating offline snapshot 6e2c889c-2b4f-40fe-9ae1-ce655123eaf2 of volume 240c531f-01b1-455e-8870-f6e43e123a00 {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:10:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3adebbf-d296-4dcc-a3e2-30ad13f82ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6927b55d-8af0-40b3-822b-7ad8dd90bd0a', 'volume_size': 1, 'source_volid': 'f2f61b0d-d009-42e6-a03d-14bda6709a00', 'source_volstatus': 'available'}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b648c80-6cb1-412f-aa91-f72eb798e943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:31 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Volume volume-6927b55d-8af0-40b3-822b-7ad8dd90bd0a (6927b55d-8af0-40b3-822b-7ad8dd90bd0a): created successfully Apr 15 20:10:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b648c80-6cb1-412f-aa91-f72eb798e943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Flow 'volume_create_manager' (2477866b-9b72-42a8-aea3-fdd1ce7e7321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:31 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4610599-aef0-4180-a2d8-0df2bb295ead]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:31 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-7604d49a-29fe-4f06-a4ea-0d7eb737e1a4 tempest-VolumeDependencyTests-1373956501 None] Created volume successfully. Apr 15 20:10:31 devstack sudo[87946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00 Apr 15 20:10:31 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-bbd3cfc9-8c7c-4c8b-9f8e-dcce4b9508db tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "cinder-f2f61b0d-d009-42e6-a03d-14bda6709a00-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-bbd3cfc9-8c7c-4c8b-9f8e-dcce4b9508db tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-f2f61b0d-d009-42e6-a03d-14bda6709a00-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:32 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00" returned: 0 in 0.484s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.6e2c889c-2b4f-40fe-9ae1-ce655123eaf2 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-bbd3cfc9-8c7c-4c8b-9f8e-dcce4b9508db tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "cinder-quobyte-f2f61b0d-d009-42e6-a03d-14bda6709a00" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:32 devstack sudo[87952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.6e2c889c-2b4f-40fe-9ae1-ce655123eaf2 1G Apr 15 20:10:32 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-bbd3cfc9-8c7c-4c8b-9f8e-dcce4b9508db tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-quobyte-f2f61b0d-d009-42e6-a03d-14bda6709a00" acquired by "delete_volume" :: waited 0.015s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:32 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca2798e-28ab-4de2-ac9f-4c357dc65dab]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bbd3cfc9-8c7c-4c8b-9f8e-dcce4b9508db tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:32 devstack sudo[87954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 Apr 15 20:10:32 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:32 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.6e2c889c-2b4f-40fe-9ae1-ce655123eaf2 1G" returned: 0 in 0.478s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-240c531f-01b1-455e-8870-f6e43e123a00 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.6e2c889c-2b4f-40fe-9ae1-ce655123eaf2 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:32 devstack sudo[87962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-240c531f-01b1-455e-8870-f6e43e123a00 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.6e2c889c-2b4f-40fe-9ae1-ce655123eaf2 Apr 15 20:10:32 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:32 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bbd3cfc9-8c7c-4c8b-9f8e-dcce4b9508db tempest-VolumeDependencyTests-1373956501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00" returned: 0 in 0.463s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bbd3cfc9-8c7c-4c8b-9f8e-dcce4b9508db tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:32 devstack sudo[87964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00 Apr 15 20:10:32 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:33 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bbd3cfc9-8c7c-4c8b-9f8e-dcce4b9508db tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2f61b0d-d009-42e6-a03d-14bda6709a00" returned: 0 in 0.384s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-bbd3cfc9-8c7c-4c8b-9f8e-dcce4b9508db tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-quobyte-f2f61b0d-d009-42e6-a03d-14bda6709a00" released by "delete_volume" :: held 0.875s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:33 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-240c531f-01b1-455e-8870-f6e43e123a00 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.6e2c889c-2b4f-40fe-9ae1-ce655123eaf2" returned: 0 in 0.432s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:33 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.6e2c889c-2b4f-40fe-9ae1-ce655123eaf2 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.6e2c889c-2b4f-40fe-9ae1-ce655123eaf2 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:33 devstack sudo[87970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.6e2c889c-2b4f-40fe-9ae1-ce655123eaf2 Apr 15 20:10:33 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-bbd3cfc9-8c7c-4c8b-9f8e-dcce4b9508db tempest-VolumeDependencyTests-1373956501 None] Created reservations ['dbdcb929-1da9-4dd2-a886-85218039172a', 'ae201492-da9e-48dd-8e52-26e4b18f496e', '3798b538-2ec2-4b03-8cfd-4d9a2e2f46ef', '53944b8b-27d3-4d38-8e4b-f221cb5992b1'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-bbd3cfc9-8c7c-4c8b-9f8e-dcce4b9508db tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-bbd3cfc9-8c7c-4c8b-9f8e-dcce4b9508db tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-bbd3cfc9-8c7c-4c8b-9f8e-dcce4b9508db tempest-VolumeDependencyTests-1373956501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-bbd3cfc9-8c7c-4c8b-9f8e-dcce4b9508db tempest-VolumeDependencyTests-1373956501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-bbd3cfc9-8c7c-4c8b-9f8e-dcce4b9508db tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bbd3cfc9-8c7c-4c8b-9f8e-dcce4b9508db tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:33 devstack sudo[87972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:10:33 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-07870fa6-cb5e-422e-a9fc-2da1a78df79e tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "cinder-6927b55d-8af0-40b3-822b-7ad8dd90bd0a-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-07870fa6-cb5e-422e-a9fc-2da1a78df79e tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-6927b55d-8af0-40b3-822b-7ad8dd90bd0a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-07870fa6-cb5e-422e-a9fc-2da1a78df79e tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "cinder-quobyte-6927b55d-8af0-40b3-822b-7ad8dd90bd0a" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-07870fa6-cb5e-422e-a9fc-2da1a78df79e tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-quobyte-6927b55d-8af0-40b3-822b-7ad8dd90bd0a" acquired by "delete_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2be7991-35a4-4900-89d3-66e36113c69d]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-07870fa6-cb5e-422e-a9fc-2da1a78df79e tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6927b55d-8af0-40b3-822b-7ad8dd90bd0a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:33 devstack sudo[87974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6927b55d-8af0-40b3-822b-7ad8dd90bd0a Apr 15 20:10:33 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:33 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.6e2c889c-2b4f-40fe-9ae1-ce655123eaf2" returned: 0 in 0.435s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:33 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:33 devstack sudo[87978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.info Apr 15 20:10:33 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bbd3cfc9-8c7c-4c8b-9f8e-dcce4b9508db tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.398s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-bbd3cfc9-8c7c-4c8b-9f8e-dcce4b9508db tempest-VolumeDependencyTests-1373956501 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:10:33 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-bbd3cfc9-8c7c-4c8b-9f8e-dcce4b9508db tempest-VolumeDependencyTests-1373956501 None] Deleted volume successfully. Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-bbd3cfc9-8c7c-4c8b-9f8e-dcce4b9508db tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-f2f61b0d-d009-42e6-a03d-14bda6709a00-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:33 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-07870fa6-cb5e-422e-a9fc-2da1a78df79e tempest-VolumeDependencyTests-1373956501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6927b55d-8af0-40b3-822b-7ad8dd90bd0a" returned: 0 in 0.478s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-07870fa6-cb5e-422e-a9fc-2da1a78df79e tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6927b55d-8af0-40b3-822b-7ad8dd90bd0a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:33 devstack sudo[87983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6927b55d-8af0-40b3-822b-7ad8dd90bd0a Apr 15 20:10:33 devstack sudo[87983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:34 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.info" returned: 0 in 0.422s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:34 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:34 devstack sudo[87986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.info Apr 15 20:10:34 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:34 devstack sudo[87983]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-07870fa6-cb5e-422e-a9fc-2da1a78df79e tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6927b55d-8af0-40b3-822b-7ad8dd90bd0a" returned: 0 in 0.388s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-07870fa6-cb5e-422e-a9fc-2da1a78df79e tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-quobyte-6927b55d-8af0-40b3-822b-7ad8dd90bd0a" released by "delete_volume" :: held 0.887s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-07870fa6-cb5e-422e-a9fc-2da1a78df79e tempest-VolumeDependencyTests-1373956501 None] Created reservations ['bfe1804d-68a8-4bbe-9a5b-8e7ed094154c', 'c66539bd-6439-4448-bfe2-6002b661fa96', 'a920bace-6d24-40af-8d3a-226efb09cf51', '66c8fe0c-c02a-42eb-a63a-a6c89b782979'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-07870fa6-cb5e-422e-a9fc-2da1a78df79e tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-07870fa6-cb5e-422e-a9fc-2da1a78df79e tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-07870fa6-cb5e-422e-a9fc-2da1a78df79e tempest-VolumeDependencyTests-1373956501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-07870fa6-cb5e-422e-a9fc-2da1a78df79e tempest-VolumeDependencyTests-1373956501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-07870fa6-cb5e-422e-a9fc-2da1a78df79e tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-07870fa6-cb5e-422e-a9fc-2da1a78df79e tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:34 devstack sudo[87989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:10:34 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:34 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.info" returned: 0 in 0.404s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.737s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] Creating offline snapshot 7b24d91c-d009-4c41-8488-2c8d9a2c8307 of volume 58d3aa30-d758-4d68-b4fc-9316dba98611 {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[681016ae-e2c9-428e-954e-6c84283a39c2]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-fba7d06a-788b-4627-9c6c-a6f4c761f782 tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "cinder-eea781f8-55e3-4094-9c13-c908a7147ff6-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-fba7d06a-788b-4627-9c6c-a6f4c761f782 tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-eea781f8-55e3-4094-9c13-c908a7147ff6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-fba7d06a-788b-4627-9c6c-a6f4c761f782 tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "cinder-quobyte-eea781f8-55e3-4094-9c13-c908a7147ff6" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-fba7d06a-788b-4627-9c6c-a6f4c761f782 tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-quobyte-eea781f8-55e3-4094-9c13-c908a7147ff6" acquired by "delete_volume" :: waited 0.015s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:34 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611 Apr 15 20:10:34 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[7deeea32-83b3-4a62-9aec-00d1ca3ac03a]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fba7d06a-788b-4627-9c6c-a6f4c761f782 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eea781f8-55e3-4094-9c13-c908a7147ff6 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:34 devstack sudo[87994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eea781f8-55e3-4094-9c13-c908a7147ff6 Apr 15 20:10:34 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:34 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-07870fa6-cb5e-422e-a9fc-2da1a78df79e tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.450s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-07870fa6-cb5e-422e-a9fc-2da1a78df79e tempest-VolumeDependencyTests-1373956501 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:10:34 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-07870fa6-cb5e-422e-a9fc-2da1a78df79e tempest-VolumeDependencyTests-1373956501 None] Deleted volume successfully. Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-07870fa6-cb5e-422e-a9fc-2da1a78df79e tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-6927b55d-8af0-40b3-822b-7ad8dd90bd0a-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:34 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611" returned: 0 in 0.480s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.7b24d91c-d009-4c41-8488-2c8d9a2c8307 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:35 devstack sudo[88000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.7b24d91c-d009-4c41-8488-2c8d9a2c8307 1G Apr 15 20:10:35 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:35 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fba7d06a-788b-4627-9c6c-a6f4c761f782 tempest-VolumeDependencyTests-1373956501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eea781f8-55e3-4094-9c13-c908a7147ff6" returned: 0 in 0.479s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fba7d06a-788b-4627-9c6c-a6f4c761f782 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eea781f8-55e3-4094-9c13-c908a7147ff6 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:35 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eea781f8-55e3-4094-9c13-c908a7147ff6 Apr 15 20:10:35 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:35 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.7b24d91c-d009-4c41-8488-2c8d9a2c8307 1G" returned: 0 in 0.462s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58d3aa30-d758-4d68-b4fc-9316dba98611 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.7b24d91c-d009-4c41-8488-2c8d9a2c8307 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:35 devstack sudo[88011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58d3aa30-d758-4d68-b4fc-9316dba98611 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.7b24d91c-d009-4c41-8488-2c8d9a2c8307 Apr 15 20:10:35 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:35 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fba7d06a-788b-4627-9c6c-a6f4c761f782 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eea781f8-55e3-4094-9c13-c908a7147ff6" returned: 0 in 0.403s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:35 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-fba7d06a-788b-4627-9c6c-a6f4c761f782 tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-quobyte-eea781f8-55e3-4094-9c13-c908a7147ff6" released by "delete_volume" :: held 0.904s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:35 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-fba7d06a-788b-4627-9c6c-a6f4c761f782 tempest-VolumeDependencyTests-1373956501 None] Created reservations ['37419bd3-d425-45b6-bc76-251d514c8628', '3ce6c092-686b-4395-b376-1f783b2d3b91', 'fbcbca97-26f1-4871-a126-c2252860d84e', '4efa8a6c-9d4c-4d9d-9ca9-84ea1bd9e96e'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fba7d06a-788b-4627-9c6c-a6f4c761f782 tempest-VolumeDependencyTests-1373956501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fba7d06a-788b-4627-9c6c-a6f4c761f782 tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:35 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-fba7d06a-788b-4627-9c6c-a6f4c761f782 tempest-VolumeDependencyTests-1373956501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:35 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-fba7d06a-788b-4627-9c6c-a6f4c761f782 tempest-VolumeDependencyTests-1373956501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fba7d06a-788b-4627-9c6c-a6f4c761f782 tempest-VolumeDependencyTests-1373956501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fba7d06a-788b-4627-9c6c-a6f4c761f782 tempest-VolumeDependencyTests-1373956501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:35 devstack sudo[88013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:10:35 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:35 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58d3aa30-d758-4d68-b4fc-9316dba98611 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.7b24d91c-d009-4c41-8488-2c8d9a2c8307" returned: 0 in 0.458s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:35 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.7b24d91c-d009-4c41-8488-2c8d9a2c8307 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 20:10:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.7b24d91c-d009-4c41-8488-2c8d9a2c8307 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:35 devstack sudo[88018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.7b24d91c-d009-4c41-8488-2c8d9a2c8307 Apr 15 20:10:35 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:36 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fba7d06a-788b-4627-9c6c-a6f4c761f782 tempest-VolumeDependencyTests-1373956501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.457s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:36 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-fba7d06a-788b-4627-9c6c-a6f4c761f782 tempest-VolumeDependencyTests-1373956501 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:10:36 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-fba7d06a-788b-4627-9c6c-a6f4c761f782 tempest-VolumeDependencyTests-1373956501 None] Deleted volume successfully. Apr 15 20:10:36 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-fba7d06a-788b-4627-9c6c-a6f4c761f782 tempest-VolumeDependencyTests-1373956501 None] Lock "cinder-eea781f8-55e3-4094-9c13-c908a7147ff6-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:36 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.7b24d91c-d009-4c41-8488-2c8d9a2c8307" returned: 0 in 0.432s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:36 devstack sudo[88022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.info Apr 15 20:10:36 devstack sudo[88022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:36 devstack sudo[88022]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.info" returned: 0 in 0.459s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:36 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 20:10:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:36 devstack sudo[88025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.info Apr 15 20:10:36 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:37 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.info" returned: 0 in 0.511s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.869s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.607s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1267626454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f372803d-ffc3-419e-b5ba-b7daab220e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1d5a7ff97f4bdfbee64c0c0f1ebc9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:30Z,use_quota=True,user_id='13dc60bb0adb445b837963f0956ea59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Creating volume f372803d-ffc3-419e-b5ba-b7daab220e9f {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:10:37 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:37 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f 1073741824 Apr 15 20:10:37 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Flow 'volume_create_manager' (4559f618-ec59-4c4d-bfa7-d79dd5063636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9779a8-cc80-48a4-9b51-212c9201d53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9779a8-cc80-48a4-9b51-212c9201d53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed204acf-eb90-424d-a3ef-632e425ef78d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a53af8cb39544d489d0c53b183c21d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:37Z,use_quota=True,user_id='ff5bc20f89014cdaa39ebd396d14c7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d943a8cf-6362-4904-b435-e3924ec45d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d943a8cf-6362-4904-b435-e3924ec45d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0566f982-63c2-4459-a11b-a96353b7063d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0566f982-63c2-4459-a11b-a96353b7063d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed204acf-eb90-424d-a3ef-632e425ef78d', 'volume_name': 'volume-ed204acf-eb90-424d-a3ef-632e425ef78d', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5aca34f-d63a-48d4-9176-d5f380bac47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5aca34f-d63a-48d4-9176-d5f380bac47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a69b57-0bd1-49e5-9d05-ed827a550d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:37 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Volume ed204acf-eb90-424d-a3ef-632e425ef78d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed204acf-eb90-424d-a3ef-632e425ef78d', 'volume_size': 1} Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:37 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-d2f58b7a-ae9c-4900-bdb1-4552967ec6f6 tempest-GroupSnapshotsTest-57414795 None] group_snapshot ec9b6b82-6291-4ed8-83eb-b4b391ee906f: created successfully Apr 15 20:10:37 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f 1073741824" returned: 0 in 0.517s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:37 devstack sudo[88033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f Apr 15 20:10:37 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:38 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f" returned: 0 in 0.433s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.814s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed204acf-eb90-424d-a3ef-632e425ef78d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a53af8cb39544d489d0c53b183c21d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:37Z,use_quota=True,user_id='ff5bc20f89014cdaa39ebd396d14c7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Creating volume ed204acf-eb90-424d-a3ef-632e425ef78d {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:10:38 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ed204acf-eb90-424d-a3ef-632e425ef78d 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54ed481-ef35-42af-896a-cb15a42bb692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f372803d-ffc3-419e-b5ba-b7daab220e9f', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf01fb60-5979-42d9-860f-40fb1b6f4ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:38 devstack sudo[88036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ed204acf-eb90-424d-a3ef-632e425ef78d 1073741824 Apr 15 20:10:38 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:38 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] group_snapshot ec9b6b82-6291-4ed8-83eb-b4b391ee906f: deleting Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] group_snapshot ec9b6b82-6291-4ed8-83eb-b4b391ee906f: deleting {{(pid=82989) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "cinder-quobyte-240c531f-01b1-455e-8870-f6e43e123a00" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:38 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Volume volume-f372803d-ffc3-419e-b5ba-b7daab220e9f (f372803d-ffc3-419e-b5ba-b7daab220e9f): created successfully Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf01fb60-5979-42d9-860f-40fb1b6f4ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Flow 'volume_create_manager' (b804b45a-fa8e-458e-9fd9-5c7f07afbf18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:38 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-518621b7-ebd9-44e9-b037-10a85f07327f tempest-VolumesDeleteCascade-2020113687 None] Created volume successfully. Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-240c531f-01b1-455e-8870-f6e43e123a00" acquired by "delete_snapshot" :: waited 0.038s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "cinder-quobyte-6e2c889c-2b4f-40fe-9ae1-ce655123eaf2" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-6e2c889c-2b4f-40fe-9ae1-ce655123eaf2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Deleting offline snapshot 6e2c889c-2b4f-40fe-9ae1-ce655123eaf2 of volume 240c531f-01b1-455e-8870-f6e43e123a00 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] snapshot_file for this snap is: volume-240c531f-01b1-455e-8870-f6e43e123a00.6e2c889c-2b4f-40fe-9ae1-ce655123eaf2 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdee541-a4bc-4957-a81c-daa14d42c289]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.6e2c889c-2b4f-40fe-9ae1-ce655123eaf2 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:38 devstack sudo[88038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.6e2c889c-2b4f-40fe-9ae1-ce655123eaf2 Apr 15 20:10:38 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:38 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ed204acf-eb90-424d-a3ef-632e425ef78d 1073741824" returned: 0 in 0.530s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ed204acf-eb90-424d-a3ef-632e425ef78d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:38 devstack sudo[88045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ed204acf-eb90-424d-a3ef-632e425ef78d Apr 15 20:10:38 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:38 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.6e2c889c-2b4f-40fe-9ae1-ce655123eaf2" returned: 0 in 0.478s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-240c531f-01b1-455e-8870-f6e43e123a00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dafb48f-9ab5-48a3-8c9d-c18d0c525438]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:39 devstack sudo[88048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00 Apr 15 20:10:39 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d3639697-93e6-4920-a4ac-8a071bbb7263 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:39 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ed204acf-eb90-424d-a3ef-632e425ef78d" returned: 0 in 0.438s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d3639697-93e6-4920-a4ac-8a071bbb7263 tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.079s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a69b57-0bd1-49e5-9d05-ed827a550d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed204acf-eb90-424d-a3ef-632e425ef78d', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426b6cab-1ae5-43a6-b086-9ef380d182ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-d3639697-93e6-4920-a4ac-8a071bbb7263 tempest-VolumesDeleteCascade-2020113687 None] Creating offline snapshot 87c651c6-aa7b-4717-81a2-f45ce07e1c2d of volume f372803d-ffc3-419e-b5ba-b7daab220e9f {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:10:39 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Volume volume-ed204acf-eb90-424d-a3ef-632e425ef78d (ed204acf-eb90-424d-a3ef-632e425ef78d): created successfully Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426b6cab-1ae5-43a6-b086-9ef380d182ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Flow 'volume_create_manager' (4559f618-ec59-4c4d-bfa7-d79dd5063636) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b4f85d-1d57-4a0f-969f-ceda3c5d9584]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d3639697-93e6-4920-a4ac-8a071bbb7263 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:39 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-c35da21c-7a08-4ba9-bbb5-54f2cb7d686a tempest-CinderUnicodeTest-73517099 None] Created volume successfully. Apr 15 20:10:39 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f Apr 15 20:10:39 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:39 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00" returned: 0 in 0.530s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.6e2c889c-2b4f-40fe-9ae1-ce655123eaf2 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:39 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.6e2c889c-2b4f-40fe-9ae1-ce655123eaf2 Apr 15 20:10:39 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:10:39 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Flow 'volume_create_manager' (5312bdb0-2dbc-4948-a9b8-62ec55d03686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (239879b3-3350-4594-86a7-027149977303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d3639697-93e6-4920-a4ac-8a071bbb7263 tempest-VolumesDeleteCascade-2020113687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f" returned: 0 in 0.550s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d3639697-93e6-4920-a4ac-8a071bbb7263 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:39 devstack sudo[88064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d 1G Apr 15 20:10:39 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (239879b3-3350-4594-86a7-027149977303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:10:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1373986309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f024e9c0-e12a-41aa-98d8-f10b0ace489f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a53af8cb39544d489d0c53b183c21d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:40Z,use_quota=True,user_id='ff5bc20f89014cdaa39ebd396d14c7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00513d9-ac7a-4ab8-9c71-251a36d896c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00513d9-ac7a-4ab8-9c71-251a36d896c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f647e80f-9984-4eea-a786-4075b9630a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f647e80f-9984-4eea-a786-4075b9630a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f024e9c0-e12a-41aa-98d8-f10b0ace489f', 'volume_name': 'volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96ed640-6b1e-49be-b486-f655476eb1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96ed640-6b1e-49be-b486-f655476eb1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37752285-7eff-498e-bb72-d58e540b84c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:39 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Volume f024e9c0-e12a-41aa-98d8-f10b0ace489f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f', 'volume_size': 1} Apr 15 20:10:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:40 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.6e2c889c-2b4f-40fe-9ae1-ce655123eaf2" returned: 0 in 0.492s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.6e2c889c-2b4f-40fe-9ae1-ce655123eaf2 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:40 devstack sudo[88066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.6e2c889c-2b4f-40fe-9ae1-ce655123eaf2 Apr 15 20:10:40 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:40 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00.6e2c889c-2b4f-40fe-9ae1-ce655123eaf2" returned: 0 in 0.443s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:40 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d3639697-93e6-4920-a4ac-8a071bbb7263 tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d 1G" returned: 0 in 0.539s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d3639697-93e6-4920-a4ac-8a071bbb7263 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f372803d-ffc3-419e-b5ba-b7daab220e9f -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:40 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-6e2c889c-2b4f-40fe-9ae1-ce655123eaf2" released by "_delete_snapshot" :: held 2.025s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:40 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-240c531f-01b1-455e-8870-f6e43e123a00" released by "delete_snapshot" :: held 2.047s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:40 devstack sudo[88072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f372803d-ffc3-419e-b5ba-b7daab220e9f -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d Apr 15 20:10:40 devstack sudo[88072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:40 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "cinder-quobyte-58d3aa30-d758-4d68-b4fc-9316dba98611" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:40 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-58d3aa30-d758-4d68-b4fc-9316dba98611" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:40 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "cinder-quobyte-7b24d91c-d009-4c41-8488-2c8d9a2c8307" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:40 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-7b24d91c-d009-4c41-8488-2c8d9a2c8307" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Deleting offline snapshot 7b24d91c-d009-4c41-8488-2c8d9a2c8307 of volume 58d3aa30-d758-4d68-b4fc-9316dba98611 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:10:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] snapshot_file for this snap is: volume-58d3aa30-d758-4d68-b4fc-9316dba98611.7b24d91c-d009-4c41-8488-2c8d9a2c8307 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:10:40 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa69d02b-b7f3-49a4-8215-e19432cf9212]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.7b24d91c-d009-4c41-8488-2c8d9a2c8307 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:40 devstack sudo[88074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.7b24d91c-d009-4c41-8488-2c8d9a2c8307 Apr 15 20:10:40 devstack sudo[88074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:40 devstack sudo[88072]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d3639697-93e6-4920-a4ac-8a071bbb7263 tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f372803d-ffc3-419e-b5ba-b7daab220e9f -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d" returned: 0 in 0.459s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:40 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-d3639697-93e6-4920-a4ac-8a071bbb7263 tempest-VolumesDeleteCascade-2020113687 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d is being set with open permissions: ugo+rw Apr 15 20:10:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d3639697-93e6-4920-a4ac-8a071bbb7263 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:40 devstack sudo[88079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d Apr 15 20:10:40 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:41 devstack sudo[88074]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.7b24d91c-d009-4c41-8488-2c8d9a2c8307" returned: 0 in 0.502s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:41 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58d3aa30-d758-4d68-b4fc-9316dba98611(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:10:41 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51e2efb-f0ce-4f5f-9c61-c0e92c47a37d]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:41 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611 Apr 15 20:10:41 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:41 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d3639697-93e6-4920-a4ac-8a071bbb7263 tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d" returned: 0 in 0.425s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d3639697-93e6-4920-a4ac-8a071bbb7263 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:41 devstack sudo[88087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.info Apr 15 20:10:41 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:41 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611" returned: 0 in 0.491s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.7b24d91c-d009-4c41-8488-2c8d9a2c8307 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:41 devstack sudo[88092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.7b24d91c-d009-4c41-8488-2c8d9a2c8307 Apr 15 20:10:41 devstack sudo[88092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:41 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d3639697-93e6-4920-a4ac-8a071bbb7263 tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.info" returned: 0 in 0.432s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:41 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-d3639697-93e6-4920-a4ac-8a071bbb7263 tempest-VolumesDeleteCascade-2020113687 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.info is being set with open permissions: ugo+rw Apr 15 20:10:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d3639697-93e6-4920-a4ac-8a071bbb7263 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:41 devstack sudo[88095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.info Apr 15 20:10:41 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:42 devstack sudo[88092]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.7b24d91c-d009-4c41-8488-2c8d9a2c8307" returned: 0 in 0.485s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.7b24d91c-d009-4c41-8488-2c8d9a2c8307 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:42 devstack sudo[88100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.7b24d91c-d009-4c41-8488-2c8d9a2c8307 Apr 15 20:10:42 devstack sudo[88100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:42 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d3639697-93e6-4920-a4ac-8a071bbb7263 tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.info" returned: 0 in 0.430s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d3639697-93e6-4920-a4ac-8a071bbb7263 tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.915s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.282s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:42 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:10:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1373986309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f024e9c0-e12a-41aa-98d8-f10b0ace489f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a53af8cb39544d489d0c53b183c21d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:40Z,use_quota=True,user_id='ff5bc20f89014cdaa39ebd396d14c7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:10:42 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Creating volume f024e9c0-e12a-41aa-98d8-f10b0ace489f {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:10:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:42 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:42 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:42 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:10:42 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:10:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:42 devstack sudo[88104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f 1073741824 Apr 15 20:10:42 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-d3639697-93e6-4920-a4ac-8a071bbb7263 tempest-VolumesDeleteCascade-2020113687 None] Create snapshot completed successfully Apr 15 20:10:42 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:42 devstack sudo[88100]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611.7b24d91c-d009-4c41-8488-2c8d9a2c8307" returned: 0 in 0.459s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-965d07dc-3c8b-4f55-9c3e-7cda5d956a7b tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:42 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-7b24d91c-d009-4c41-8488-2c8d9a2c8307" released by "_delete_snapshot" :: held 2.003s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:42 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-58d3aa30-d758-4d68-b4fc-9316dba98611" released by "delete_snapshot" :: held 2.015s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:42 devstack cinder-volume[82989]: WARNING cinder.quota [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-796978035 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-796978035, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:10:42 devstack cinder-volume[82989]: WARNING cinder.quota [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-796978035 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-796978035, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:10:42 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Created reservations ['36a864db-86f3-4214-94f1-b7750b75208e', 'c5febd8b-ad87-4f0b-abe4-b21bbdb1616a', '500e27d0-3886-4a10-a466-1ee9d6d4efb5', 'e80fca2f-43ab-4ade-9086-8c36e832c085'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:42 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] Created reservations ['5a39b329-a7e9-4c25-8160-5ce474fcb32c', '03cf9a4d-a503-4caa-8066-1de8559b1f74', '05378977-a338-44e5-95f8-6336bc0cdb3c', '010bb590-c857-4eae-86cc-0550da07642d'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:42 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-eae14d9f-e788-4dd6-a2f6-2f37aa318a8a tempest-GroupSnapshotsTest-57414795 None] group_snapshot ec9b6b82-6291-4ed8-83eb-b4b391ee906f: deleted successfully Apr 15 20:10:42 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f 1073741824" returned: 0 in 0.535s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:42 devstack sudo[88110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f Apr 15 20:10:42 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:43 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f" returned: 0 in 0.396s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:10:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-965d07dc-3c8b-4f55-9c3e-7cda5d956a7b tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.703s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37752285-7eff-498e-bb72-d58e540b84c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0568ba0e-2df7-40e6-ae4f-b537ff356fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:43 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Volume volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f (f024e9c0-e12a-41aa-98d8-f10b0ace489f): created successfully Apr 15 20:10:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0568ba0e-2df7-40e6-ae4f-b537ff356fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Flow 'volume_create_manager' (5312bdb0-2dbc-4948-a9b8-62ec55d03686) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-965d07dc-3c8b-4f55-9c3e-7cda5d956a7b tempest-VolumesDeleteCascade-2020113687 None] Creating offline snapshot f8f85a96-b49b-41e4-8562-480dac54eea6 of volume f372803d-ffc3-419e-b5ba-b7daab220e9f {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:10:43 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-32db0d78-397b-46a8-8a6d-9b121a0bc8bf tempest-CinderUnicodeTest-73517099 None] Created volume successfully. Apr 15 20:10:43 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c822d57-5514-4daf-a95c-45c41b080a69]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-965d07dc-3c8b-4f55-9c3e-7cda5d956a7b tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:43 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d Apr 15 20:10:43 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:43 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-965d07dc-3c8b-4f55-9c3e-7cda5d956a7b tempest-VolumesDeleteCascade-2020113687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d" returned: 0 in 0.460s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-965d07dc-3c8b-4f55-9c3e-7cda5d956a7b tempest-VolumesDeleteCascade-2020113687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f372803d-ffc3-419e-b5ba-b7daab220e9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:10:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-965d07dc-3c8b-4f55-9c3e-7cda5d956a7b tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:43 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6 1G Apr 15 20:10:43 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:43 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "cinder-quobyte-240c531f-01b1-455e-8870-f6e43e123a00" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:43 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-240c531f-01b1-455e-8870-f6e43e123a00" acquired by "delete_volume" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:43 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd1a945-60cf-4b79-8278-7ccbaf50dcff]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:43 devstack sudo[88120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00 Apr 15 20:10:43 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:44 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-965d07dc-3c8b-4f55-9c3e-7cda5d956a7b tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6 1G" returned: 0 in 0.539s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-965d07dc-3c8b-4f55-9c3e-7cda5d956a7b tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:44 devstack sudo[88125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6 Apr 15 20:10:44 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a8c91247-6203-4ffb-95b3-23fb135b2b5f tempest-CinderUnicodeTest-73517099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:44 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00" returned: 0 in 0.560s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:44 devstack sudo[88130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00 Apr 15 20:10:44 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:44 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-965d07dc-3c8b-4f55-9c3e-7cda5d956a7b tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6" returned: 0 in 0.427s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:44 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-965d07dc-3c8b-4f55-9c3e-7cda5d956a7b tempest-VolumesDeleteCascade-2020113687 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6 is being set with open permissions: ugo+rw Apr 15 20:10:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-965d07dc-3c8b-4f55-9c3e-7cda5d956a7b tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:44 devstack sudo[88135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6 Apr 15 20:10:44 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:44 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-240c531f-01b1-455e-8870-f6e43e123a00" returned: 0 in 0.406s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:44 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-240c531f-01b1-455e-8870-f6e43e123a00" released by "delete_volume" :: held 0.995s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:44 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "cinder-quobyte-58d3aa30-d758-4d68-b4fc-9316dba98611" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:44 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-58d3aa30-d758-4d68-b4fc-9316dba98611" acquired by "delete_volume" :: waited 0.006s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:44 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[e660c4b5-fe7a-4996-8807-5968035ad09d]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:44 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611 Apr 15 20:10:44 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:45 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-965d07dc-3c8b-4f55-9c3e-7cda5d956a7b tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6" returned: 0 in 0.406s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-965d07dc-3c8b-4f55-9c3e-7cda5d956a7b tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.909s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a8c91247-6203-4ffb-95b3-23fb135b2b5f tempest-CinderUnicodeTest-73517099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.835s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-a8c91247-6203-4ffb-95b3-23fb135b2b5f tempest-CinderUnicodeTest-73517099 None] Creating offline snapshot b145c459-a4ec-49b1-a799-9db984b01c2f of volume f024e9c0-e12a-41aa-98d8-f10b0ace489f {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b109c3-880a-43b8-98b4-b91b3b48aa2a]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a8c91247-6203-4ffb-95b3-23fb135b2b5f tempest-CinderUnicodeTest-73517099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:45 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-965d07dc-3c8b-4f55-9c3e-7cda5d956a7b tempest-VolumesDeleteCascade-2020113687 None] Create snapshot completed successfully Apr 15 20:10:45 devstack sudo[88141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f Apr 15 20:10:45 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:45 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611" returned: 0 in 0.475s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:45 devstack sudo[88146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611 Apr 15 20:10:45 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "cinder-f372803d-ffc3-419e-b5ba-b7daab220e9f-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-f372803d-ffc3-419e-b5ba-b7daab220e9f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:45 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a8c91247-6203-4ffb-95b3-23fb135b2b5f tempest-CinderUnicodeTest-73517099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f" returned: 0 in 0.510s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a8c91247-6203-4ffb-95b3-23fb135b2b5f tempest-CinderUnicodeTest-73517099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.b145c459-a4ec-49b1-a799-9db984b01c2f 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:45 devstack sudo[88152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.b145c459-a4ec-49b1-a799-9db984b01c2f 1G Apr 15 20:10:45 devstack sudo[88152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Performing cascade delete. {{(pid=82989) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "cinder-87c651c6-aa7b-4717-81a2-f45ce07e1c2d-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-87c651c6-aa7b-4717-81a2-f45ce07e1c2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "cinder-quobyte-f372803d-ffc3-419e-b5ba-b7daab220e9f" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-quobyte-f372803d-ffc3-419e-b5ba-b7daab220e9f" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "cinder-quobyte-87c651c6-aa7b-4717-81a2-f45ce07e1c2d" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:45 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-quobyte-87c651c6-aa7b-4717-81a2-f45ce07e1c2d" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Deleting offline snapshot 87c651c6-aa7b-4717-81a2-f45ce07e1c2d of volume f372803d-ffc3-419e-b5ba-b7daab220e9f {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] snapshot_file for this snap is: volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-58d3aa30-d758-4d68-b4fc-9316dba98611" returned: 0 in 0.422s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[2524f039-f560-4a53-a9b1-5b2fbd2256ce]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-58d3aa30-d758-4d68-b4fc-9316dba98611" released by "delete_volume" :: held 0.934s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] Created reservations ['e673057b-3874-4457-9d68-d63f2f0be92d'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:45 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d Apr 15 20:10:45 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:45 devstack cinder-volume[82989]: WARNING cinder.quota [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-796978035 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-796978035, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] Created reservations ['b4f78c74-7237-4d81-8d50-7cb1c423c6e7', '779347e5-dcd7-4cb7-9b37-16bf53440678', 'dcc0f7be-97db-4054-9f62-2fa309e6abb1', '5845ee5a-20c5-4039-959c-f2af795e70db'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:45 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] Created reservations ['2fd7f4de-c16c-469e-8b8b-9f99a75b7b30', '7ebe5ab6-12a8-48eb-bf33-b88417c4d650', '82011e9b-0241-4699-92d2-f1b97d2f8c6f', '22b3e5dd-43e4-47c9-8071-90d4f4a44eaf'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:46 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:46 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:46 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:10:46 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:46 devstack sudo[88152]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a8c91247-6203-4ffb-95b3-23fb135b2b5f tempest-CinderUnicodeTest-73517099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.b145c459-a4ec-49b1-a799-9db984b01c2f 1G" returned: 0 in 0.531s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a8c91247-6203-4ffb-95b3-23fb135b2b5f tempest-CinderUnicodeTest-73517099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.b145c459-a4ec-49b1-a799-9db984b01c2f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:46 devstack sudo[88164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.b145c459-a4ec-49b1-a799-9db984b01c2f Apr 15 20:10:46 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:46 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d" returned: 0 in 0.506s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:46 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f372803d-ffc3-419e-b5ba-b7daab220e9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:10:46 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa18b08-3157-40c4-9653-94bcb46e355a]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:46 devstack sudo[88166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f Apr 15 20:10:46 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:46 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.430s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:46 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:10:46 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-8eca9854-d5d0-462d-9b69-1ffd8a82b660 tempest-GroupSnapshotsTest-57414795 None] Delete group completed successfully. Apr 15 20:10:46 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a8c91247-6203-4ffb-95b3-23fb135b2b5f tempest-CinderUnicodeTest-73517099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.b145c459-a4ec-49b1-a799-9db984b01c2f" returned: 0 in 0.439s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:46 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-a8c91247-6203-4ffb-95b3-23fb135b2b5f tempest-CinderUnicodeTest-73517099 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.b145c459-a4ec-49b1-a799-9db984b01c2f is being set with open permissions: ugo+rw Apr 15 20:10:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a8c91247-6203-4ffb-95b3-23fb135b2b5f tempest-CinderUnicodeTest-73517099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.b145c459-a4ec-49b1-a799-9db984b01c2f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:46 devstack sudo[88172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.b145c459-a4ec-49b1-a799-9db984b01c2f Apr 15 20:10:46 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:46 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f" returned: 0 in 0.488s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:46 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[f618b530-36a1-4024-925a-d857301f1293]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:46 devstack sudo[88177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6 Apr 15 20:10:46 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:47 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a8c91247-6203-4ffb-95b3-23fb135b2b5f tempest-CinderUnicodeTest-73517099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.b145c459-a4ec-49b1-a799-9db984b01c2f" returned: 0 in 0.436s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a8c91247-6203-4ffb-95b3-23fb135b2b5f tempest-CinderUnicodeTest-73517099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:47 devstack sudo[88180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.info Apr 15 20:10:47 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:47 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6" returned: 0 in 0.495s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:47 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f372803d-ffc3-419e-b5ba-b7daab220e9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:10:47 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dbdaf8-2187-44b1-b093-c91ee8a95059]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:47 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-c5b3e2a7-f0ef-41f2-8a22-65a7f5216f87 tempest-GroupSnapshotsTest-57414795 None] Group tempest-GroupSnapshotsTest-Group-330982736: creating Apr 15 20:10:47 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-c5b3e2a7-f0ef-41f2-8a22-65a7f5216f87 tempest-GroupSnapshotsTest-57414795 None] Group tempest-GroupSnapshotsTest-Group-330982736: created successfully Apr 15 20:10:47 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-c5b3e2a7-f0ef-41f2-8a22-65a7f5216f87 tempest-GroupSnapshotsTest-57414795 None] Create group completed successfully. Apr 15 20:10:47 devstack sudo[88185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d Apr 15 20:10:47 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:47 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a8c91247-6203-4ffb-95b3-23fb135b2b5f tempest-CinderUnicodeTest-73517099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.info" returned: 0 in 0.419s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:47 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-a8c91247-6203-4ffb-95b3-23fb135b2b5f tempest-CinderUnicodeTest-73517099 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.info is being set with open permissions: ugo+rw Apr 15 20:10:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a8c91247-6203-4ffb-95b3-23fb135b2b5f tempest-CinderUnicodeTest-73517099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:47 devstack sudo[88189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.info Apr 15 20:10:47 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:47 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d" returned: 0 in 0.470s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:47 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f372803d-ffc3-419e-b5ba-b7daab220e9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:10:47 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bba6521-7cec-41db-9b29-309775cca0f0]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:47 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f Apr 15 20:10:47 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:47 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a8c91247-6203-4ffb-95b3-23fb135b2b5f tempest-CinderUnicodeTest-73517099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.info" returned: 0 in 0.400s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a8c91247-6203-4ffb-95b3-23fb135b2b5f tempest-CinderUnicodeTest-73517099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.795s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:47 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-a8c91247-6203-4ffb-95b3-23fb135b2b5f tempest-CinderUnicodeTest-73517099 None] Create snapshot completed successfully Apr 15 20:10:48 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f" returned: 0 in 0.448s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:48 devstack sudo[88200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d Apr 15 20:10:48 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f3c4bfb2-eb1c-4a41-b462-02dca622b4e6 tempest-CinderUnicodeTest-73517099 None] Acquiring lock "cinder-b145c459-a4ec-49b1-a799-9db984b01c2f-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f3c4bfb2-eb1c-4a41-b462-02dca622b4e6 tempest-CinderUnicodeTest-73517099 None] Lock "cinder-b145c459-a4ec-49b1-a799-9db984b01c2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f3c4bfb2-eb1c-4a41-b462-02dca622b4e6 tempest-CinderUnicodeTest-73517099 None] Acquiring lock "cinder-quobyte-f024e9c0-e12a-41aa-98d8-f10b0ace489f" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f3c4bfb2-eb1c-4a41-b462-02dca622b4e6 tempest-CinderUnicodeTest-73517099 None] Lock "cinder-quobyte-f024e9c0-e12a-41aa-98d8-f10b0ace489f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f3c4bfb2-eb1c-4a41-b462-02dca622b4e6 tempest-CinderUnicodeTest-73517099 None] Acquiring lock "cinder-quobyte-b145c459-a4ec-49b1-a799-9db984b01c2f" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f3c4bfb2-eb1c-4a41-b462-02dca622b4e6 tempest-CinderUnicodeTest-73517099 None] Lock "cinder-quobyte-b145c459-a4ec-49b1-a799-9db984b01c2f" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-f3c4bfb2-eb1c-4a41-b462-02dca622b4e6 tempest-CinderUnicodeTest-73517099 None] Deleting offline snapshot b145c459-a4ec-49b1-a799-9db984b01c2f of volume f024e9c0-e12a-41aa-98d8-f10b0ace489f {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-f3c4bfb2-eb1c-4a41-b462-02dca622b4e6 tempest-CinderUnicodeTest-73517099 None] snapshot_file for this snap is: volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.b145c459-a4ec-49b1-a799-9db984b01c2f {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b415f50-48fb-4c72-813e-0044b625eb8a]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f3c4bfb2-eb1c-4a41-b462-02dca622b4e6 tempest-CinderUnicodeTest-73517099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.b145c459-a4ec-49b1-a799-9db984b01c2f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:48 devstack sudo[88202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.b145c459-a4ec-49b1-a799-9db984b01c2f Apr 15 20:10:48 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Flow 'volume_create_manager' (8066651a-6a56-4a19-b33c-eaf0e450693c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d87c4d73-1194-4147-add2-a62e683abec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d87c4d73-1194-4147-add2-a62e683abec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-731537987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c64dab22-89f5-455a-9cf6-aae60b5b36a6,host='devstack@QuobyteHD#QuobyteHD',id=81e8777a-97fa-4765-b3fa-afd71703851c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2478e26b98964590aaa0437bc826fd28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:49Z,use_quota=True,user_id='a471c8f5d63048458961f9b21a24a704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e81d817-d880-4f74-abf9-369410256318),volume_type_id=1e81d817-d880-4f74-abf9-369410256318)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83569b4-e6ea-4ba4-8e65-2a3cda1cf99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83569b4-e6ea-4ba4-8e65-2a3cda1cf99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9b646f0-87f4-4b40-8601-582d15b7c87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9b646f0-87f4-4b40-8601-582d15b7c87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81e8777a-97fa-4765-b3fa-afd71703851c', 'volume_name': 'volume-81e8777a-97fa-4765-b3fa-afd71703851c', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4bade91-72d4-4a4c-b881-80e4ba741805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4bade91-72d4-4a4c-b881-80e4ba741805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d4928e-f415-4094-abb5-f3d9510af6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:48 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Volume 81e8777a-97fa-4765-b3fa-afd71703851c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81e8777a-97fa-4765-b3fa-afd71703851c', 'volume_size': 1} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c64dab22-89f5-455a-9cf6-aae60b5b36a6,created_at=2026-04-15T18:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-731537987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c64dab22-89f5-455a-9cf6-aae60b5b36a6,host='devstack@QuobyteHD#QuobyteHD',id=81e8777a-97fa-4765-b3fa-afd71703851c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2478e26b98964590aaa0437bc826fd28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:49Z,use_quota=True,user_id='a471c8f5d63048458961f9b21a24a704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e81d817-d880-4f74-abf9-369410256318),volume_type_id=1e81d817-d880-4f74-abf9-369410256318)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Creating volume 81e8777a-97fa-4765-b3fa-afd71703851c {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:10:48 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:48 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d" returned: 0 in 0.517s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:48 devstack sudo[88207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c 1073741824 Apr 15 20:10:48 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:48 devstack sudo[88208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d Apr 15 20:10:48 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:49 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f3c4bfb2-eb1c-4a41-b462-02dca622b4e6 tempest-CinderUnicodeTest-73517099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.b145c459-a4ec-49b1-a799-9db984b01c2f" returned: 0 in 0.496s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-f3c4bfb2-eb1c-4a41-b462-02dca622b4e6 tempest-CinderUnicodeTest-73517099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e7a1eb-3851-45e6-b44a-debebaa0305c]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f3c4bfb2-eb1c-4a41-b462-02dca622b4e6 tempest-CinderUnicodeTest-73517099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:49 devstack sudo[88214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f Apr 15 20:10:49 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:49 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.87c651c6-aa7b-4717-81a2-f45ce07e1c2d" returned: 0 in 0.404s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f372803d-ffc3-419e-b5ba-b7daab220e9f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6 -F qcow2 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:49 devstack sudo[88220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f372803d-ffc3-419e-b5ba-b7daab220e9f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6 -F qcow2 Apr 15 20:10:49 devstack sudo[88220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:49 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c 1073741824" returned: 0 in 0.498s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:49 devstack sudo[88222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c Apr 15 20:10:49 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:49 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f3c4bfb2-eb1c-4a41-b462-02dca622b4e6 tempest-CinderUnicodeTest-73517099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f" returned: 0 in 0.461s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f3c4bfb2-eb1c-4a41-b462-02dca622b4e6 tempest-CinderUnicodeTest-73517099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.b145c459-a4ec-49b1-a799-9db984b01c2f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:49 devstack sudo[88229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.b145c459-a4ec-49b1-a799-9db984b01c2f Apr 15 20:10:49 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:49 devstack sudo[88220]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f372803d-ffc3-419e-b5ba-b7daab220e9f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6 -F qcow2" returned: 0 in 0.435s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-quobyte-87c651c6-aa7b-4717-81a2-f45ce07e1c2d" released by "_delete_snapshot" :: held 3.855s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-quobyte-f372803d-ffc3-419e-b5ba-b7daab220e9f" released by "delete_snapshot" :: held 3.875s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Created reservations ['19449287-792f-45c2-9550-77f603997c05', '88036921-9036-45e7-9257-fe7ed3445d5e', '447c10d0-bece-4bcf-82cc-924a994c07d0', '0e256591-a538-4be9-8601-cbaafbc6943a'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:49 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c" returned: 0 in 0.416s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d4928e-f415-4094-abb5-f3d9510af6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81e8777a-97fa-4765-b3fa-afd71703851c', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe67e8b-f9fe-47a5-ac74-d12bb40cc426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:49 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Volume volume-81e8777a-97fa-4765-b3fa-afd71703851c (81e8777a-97fa-4765-b3fa-afd71703851c): created successfully Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe67e8b-f9fe-47a5-ac74-d12bb40cc426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Flow 'volume_create_manager' (8066651a-6a56-4a19-b33c-eaf0e450693c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:49 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-0d5e4af9-a655-40e9-be18-f1bcecb4359d tempest-GroupSnapshotsTest-57414795 None] Created volume successfully. Apr 15 20:10:49 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Delete snapshot completed successfully. Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-87c651c6-aa7b-4717-81a2-f45ce07e1c2d-delete_snapshot" released by "delete_snapshot" :: held 4.020s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "cinder-f8f85a96-b49b-41e4-8562-480dac54eea6-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-f8f85a96-b49b-41e4-8562-480dac54eea6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "cinder-quobyte-f372803d-ffc3-419e-b5ba-b7daab220e9f" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-quobyte-f372803d-ffc3-419e-b5ba-b7daab220e9f" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "cinder-quobyte-f8f85a96-b49b-41e4-8562-480dac54eea6" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-quobyte-f8f85a96-b49b-41e4-8562-480dac54eea6" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Deleting offline snapshot f8f85a96-b49b-41e4-8562-480dac54eea6 of volume f372803d-ffc3-419e-b5ba-b7daab220e9f {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] snapshot_file for this snap is: volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[4397bbf0-f404-4f8d-974b-7fb36cf55cca]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:49 devstack sudo[88233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6 Apr 15 20:10:49 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:49 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f3c4bfb2-eb1c-4a41-b462-02dca622b4e6 tempest-CinderUnicodeTest-73517099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.b145c459-a4ec-49b1-a799-9db984b01c2f" returned: 0 in 0.463s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f3c4bfb2-eb1c-4a41-b462-02dca622b4e6 tempest-CinderUnicodeTest-73517099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.b145c459-a4ec-49b1-a799-9db984b01c2f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:49 devstack sudo[88238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.b145c459-a4ec-49b1-a799-9db984b01c2f Apr 15 20:10:49 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:50 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6" returned: 0 in 0.461s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:50 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f372803d-ffc3-419e-b5ba-b7daab220e9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:10:50 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26ba57a-b42b-4030-81eb-fc53b9ecc304]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:50 devstack sudo[88243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f Apr 15 20:10:50 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:50 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f3c4bfb2-eb1c-4a41-b462-02dca622b4e6 tempest-CinderUnicodeTest-73517099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f.b145c459-a4ec-49b1-a799-9db984b01c2f" returned: 0 in 0.402s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:50 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f3c4bfb2-eb1c-4a41-b462-02dca622b4e6 tempest-CinderUnicodeTest-73517099 None] Lock "cinder-quobyte-b145c459-a4ec-49b1-a799-9db984b01c2f" released by "_delete_snapshot" :: held 1.879s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:50 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f3c4bfb2-eb1c-4a41-b462-02dca622b4e6 tempest-CinderUnicodeTest-73517099 None] Lock "cinder-quobyte-f024e9c0-e12a-41aa-98d8-f10b0ace489f" released by "delete_snapshot" :: held 1.891s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:50 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-f3c4bfb2-eb1c-4a41-b462-02dca622b4e6 tempest-CinderUnicodeTest-73517099 None] Created reservations ['b1068046-e4ad-4e3f-a6b2-8dad1ba156d8', '99050624-6759-43c8-b944-1de35a06c17e', '5a47d021-37df-4ace-bcd2-8c64a1c60085', '103abd63-5279-48c1-885a-030e6c5a43eb'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:50 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-f3c4bfb2-eb1c-4a41-b462-02dca622b4e6 tempest-CinderUnicodeTest-73517099 None] Delete snapshot completed successfully. Apr 15 20:10:50 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f3c4bfb2-eb1c-4a41-b462-02dca622b4e6 tempest-CinderUnicodeTest-73517099 None] Lock "cinder-b145c459-a4ec-49b1-a799-9db984b01c2f-delete_snapshot" released by "delete_snapshot" :: held 1.975s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:50 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f1c2981d-7bbf-4311-8f2a-6ad242f53f41 tempest-CinderUnicodeTest-73517099 None] Acquiring lock "cinder-f024e9c0-e12a-41aa-98d8-f10b0ace489f-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:50 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f1c2981d-7bbf-4311-8f2a-6ad242f53f41 tempest-CinderUnicodeTest-73517099 None] Lock "cinder-f024e9c0-e12a-41aa-98d8-f10b0ace489f-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:50 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f1c2981d-7bbf-4311-8f2a-6ad242f53f41 tempest-CinderUnicodeTest-73517099 None] Acquiring lock "cinder-quobyte-f024e9c0-e12a-41aa-98d8-f10b0ace489f" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:50 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f1c2981d-7bbf-4311-8f2a-6ad242f53f41 tempest-CinderUnicodeTest-73517099 None] Lock "cinder-quobyte-f024e9c0-e12a-41aa-98d8-f10b0ace489f" acquired by "delete_volume" :: waited 0.006s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:50 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce51d163-8dd4-40fa-b942-8843470a18e6]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f1c2981d-7bbf-4311-8f2a-6ad242f53f41 tempest-CinderUnicodeTest-73517099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:50 devstack sudo[88246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f Apr 15 20:10:50 devstack sudo[88246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:50 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f" returned: 0 in 0.509s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:50 devstack sudo[88251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6 Apr 15 20:10:50 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:50 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-cb0513da-af66-4f7a-8a34-d540ba57089d tempest-GroupSnapshotsTest-57414795 None] GroupSnapshot db557058-11c5-4cc0-b355-0c68b03ab3e7: creating. Apr 15 20:10:50 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-cb0513da-af66-4f7a-8a34-d540ba57089d tempest-GroupSnapshotsTest-57414795 None] Group snapshot db557058-11c5-4cc0-b355-0c68b03ab3e7: creating. {{(pid=82989) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 20:10:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cb0513da-af66-4f7a-8a34-d540ba57089d tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cb0513da-af66-4f7a-8a34-d540ba57089d tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:50 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-cb0513da-af66-4f7a-8a34-d540ba57089d tempest-GroupSnapshotsTest-57414795 None] Creating offline snapshot bae75686-cec0-40e7-bba7-1f524122f7d1 of volume 81e8777a-97fa-4765-b3fa-afd71703851c {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:10:50 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34fb642-d317-44ec-b3a6-c9dd0e813b8b]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cb0513da-af66-4f7a-8a34-d540ba57089d tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:51 devstack sudo[88253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c Apr 15 20:10:51 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:51 devstack sudo[88246]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f1c2981d-7bbf-4311-8f2a-6ad242f53f41 tempest-CinderUnicodeTest-73517099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f" returned: 0 in 0.498s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f1c2981d-7bbf-4311-8f2a-6ad242f53f41 tempest-CinderUnicodeTest-73517099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:51 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f Apr 15 20:10:51 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:51 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6" returned: 0 in 0.452s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:51 devstack sudo[88263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6 Apr 15 20:10:51 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:51 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cb0513da-af66-4f7a-8a34-d540ba57089d tempest-GroupSnapshotsTest-57414795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c" returned: 0 in 0.463s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cb0513da-af66-4f7a-8a34-d540ba57089d tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.bae75686-cec0-40e7-bba7-1f524122f7d1 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:51 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.bae75686-cec0-40e7-bba7-1f524122f7d1 1G Apr 15 20:10:51 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:51 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f1c2981d-7bbf-4311-8f2a-6ad242f53f41 tempest-CinderUnicodeTest-73517099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f024e9c0-e12a-41aa-98d8-f10b0ace489f" returned: 0 in 0.415s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f1c2981d-7bbf-4311-8f2a-6ad242f53f41 tempest-CinderUnicodeTest-73517099 None] Lock "cinder-quobyte-f024e9c0-e12a-41aa-98d8-f10b0ace489f" released by "delete_volume" :: held 0.951s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-f1c2981d-7bbf-4311-8f2a-6ad242f53f41 tempest-CinderUnicodeTest-73517099 None] Created reservations ['a1f580a0-4d30-457e-ab03-4dfc0346a572', '73b146cf-7b23-4284-8b50-12e605fb688f', '24453279-d3a5-4b4d-8169-a6df985b2929', '46251c9e-c27e-4611-a8d0-8fe9330856cb'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f1c2981d-7bbf-4311-8f2a-6ad242f53f41 tempest-CinderUnicodeTest-73517099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f1c2981d-7bbf-4311-8f2a-6ad242f53f41 tempest-CinderUnicodeTest-73517099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f1c2981d-7bbf-4311-8f2a-6ad242f53f41 tempest-CinderUnicodeTest-73517099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f1c2981d-7bbf-4311-8f2a-6ad242f53f41 tempest-CinderUnicodeTest-73517099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f1c2981d-7bbf-4311-8f2a-6ad242f53f41 tempest-CinderUnicodeTest-73517099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f1c2981d-7bbf-4311-8f2a-6ad242f53f41 tempest-CinderUnicodeTest-73517099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:51 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f.f8f85a96-b49b-41e4-8562-480dac54eea6" returned: 0 in 0.417s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:51 devstack sudo[88272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:10:51 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-quobyte-f8f85a96-b49b-41e4-8562-480dac54eea6" released by "_delete_snapshot" :: held 1.882s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-quobyte-f372803d-ffc3-419e-b5ba-b7daab220e9f" released by "delete_snapshot" :: held 1.892s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6e930a33-4a9e-4755-9e46-f8f0d37dbcb9 tempest-CinderUnicodeTest-73517099 None] Acquiring lock "cinder-ed204acf-eb90-424d-a3ef-632e425ef78d-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6e930a33-4a9e-4755-9e46-f8f0d37dbcb9 tempest-CinderUnicodeTest-73517099 None] Lock "cinder-ed204acf-eb90-424d-a3ef-632e425ef78d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Created reservations ['1c9e8d92-27c5-49ad-af41-93b95c05509f', 'c3364a1b-b1e2-4351-91f5-3a8addddc1ad', '2c7b5f06-3596-4f4e-aa67-ca61528b5991', 'd195ed09-2bd2-4f8e-bc7d-de0ef64cb205'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6e930a33-4a9e-4755-9e46-f8f0d37dbcb9 tempest-CinderUnicodeTest-73517099 None] Acquiring lock "cinder-quobyte-ed204acf-eb90-424d-a3ef-632e425ef78d" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6e930a33-4a9e-4755-9e46-f8f0d37dbcb9 tempest-CinderUnicodeTest-73517099 None] Lock "cinder-quobyte-ed204acf-eb90-424d-a3ef-632e425ef78d" acquired by "delete_volume" :: waited 0.033s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:51 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Delete snapshot completed successfully. Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb50e554-d034-48c8-b9b4-fcbf0b4859e0]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6e930a33-4a9e-4755-9e46-f8f0d37dbcb9 tempest-CinderUnicodeTest-73517099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ed204acf-eb90-424d-a3ef-632e425ef78d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-f8f85a96-b49b-41e4-8562-480dac54eea6-delete_snapshot" released by "delete_snapshot" :: held 2.046s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Snapshots deleted, issuing volume delete {{(pid=82989) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "cinder-quobyte-f372803d-ffc3-419e-b5ba-b7daab220e9f" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-quobyte-f372803d-ffc3-419e-b5ba-b7daab220e9f" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a4aec3-dd88-4086-81ae-f158a9b7bd0a]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:51 devstack sudo[88274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ed204acf-eb90-424d-a3ef-632e425ef78d Apr 15 20:10:51 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:51 devstack sudo[88278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f Apr 15 20:10:51 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:51 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cb0513da-af66-4f7a-8a34-d540ba57089d tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.bae75686-cec0-40e7-bba7-1f524122f7d1 1G" returned: 0 in 0.498s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cb0513da-af66-4f7a-8a34-d540ba57089d tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81e8777a-97fa-4765-b3fa-afd71703851c -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.bae75686-cec0-40e7-bba7-1f524122f7d1 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:51 devstack sudo[88281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81e8777a-97fa-4765-b3fa-afd71703851c -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.bae75686-cec0-40e7-bba7-1f524122f7d1 Apr 15 20:10:51 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:52 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f1c2981d-7bbf-4311-8f2a-6ad242f53f41 tempest-CinderUnicodeTest-73517099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.444s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-f1c2981d-7bbf-4311-8f2a-6ad242f53f41 tempest-CinderUnicodeTest-73517099 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:10:52 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-f1c2981d-7bbf-4311-8f2a-6ad242f53f41 tempest-CinderUnicodeTest-73517099 None] Deleted volume successfully. Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f1c2981d-7bbf-4311-8f2a-6ad242f53f41 tempest-CinderUnicodeTest-73517099 None] Lock "cinder-f024e9c0-e12a-41aa-98d8-f10b0ace489f-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:52 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6e930a33-4a9e-4755-9e46-f8f0d37dbcb9 tempest-CinderUnicodeTest-73517099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ed204acf-eb90-424d-a3ef-632e425ef78d" returned: 0 in 0.480s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6e930a33-4a9e-4755-9e46-f8f0d37dbcb9 tempest-CinderUnicodeTest-73517099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ed204acf-eb90-424d-a3ef-632e425ef78d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:52 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ed204acf-eb90-424d-a3ef-632e425ef78d Apr 15 20:10:52 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:52 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f" returned: 0 in 0.543s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:52 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f Apr 15 20:10:52 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:52 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cb0513da-af66-4f7a-8a34-d540ba57089d tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81e8777a-97fa-4765-b3fa-afd71703851c -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.bae75686-cec0-40e7-bba7-1f524122f7d1" returned: 0 in 0.451s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:52 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-cb0513da-af66-4f7a-8a34-d540ba57089d tempest-GroupSnapshotsTest-57414795 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.bae75686-cec0-40e7-bba7-1f524122f7d1 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cb0513da-af66-4f7a-8a34-d540ba57089d tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.bae75686-cec0-40e7-bba7-1f524122f7d1 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:52 devstack sudo[88298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.bae75686-cec0-40e7-bba7-1f524122f7d1 Apr 15 20:10:52 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:52 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6e930a33-4a9e-4755-9e46-f8f0d37dbcb9 tempest-CinderUnicodeTest-73517099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ed204acf-eb90-424d-a3ef-632e425ef78d" returned: 0 in 0.403s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6e930a33-4a9e-4755-9e46-f8f0d37dbcb9 tempest-CinderUnicodeTest-73517099 None] Lock "cinder-quobyte-ed204acf-eb90-424d-a3ef-632e425ef78d" released by "delete_volume" :: held 0.904s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-6e930a33-4a9e-4755-9e46-f8f0d37dbcb9 tempest-CinderUnicodeTest-73517099 None] Created reservations ['0db8160f-10e3-46a3-b73c-ed888a265d5b', '86b0e52b-5d3c-4802-8702-dc93d3da6b3b', '7e52b1be-ddbd-4ca7-8ba1-9773974dc636', 'a21bff4d-02ca-4176-8b37-1f7e1d7f99b0'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-6e930a33-4a9e-4755-9e46-f8f0d37dbcb9 tempest-CinderUnicodeTest-73517099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-6e930a33-4a9e-4755-9e46-f8f0d37dbcb9 tempest-CinderUnicodeTest-73517099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-6e930a33-4a9e-4755-9e46-f8f0d37dbcb9 tempest-CinderUnicodeTest-73517099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-6e930a33-4a9e-4755-9e46-f8f0d37dbcb9 tempest-CinderUnicodeTest-73517099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-6e930a33-4a9e-4755-9e46-f8f0d37dbcb9 tempest-CinderUnicodeTest-73517099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6e930a33-4a9e-4755-9e46-f8f0d37dbcb9 tempest-CinderUnicodeTest-73517099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:52 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f372803d-ffc3-419e-b5ba-b7daab220e9f" returned: 0 in 0.418s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:52 devstack sudo[88303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:10:52 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-quobyte-f372803d-ffc3-419e-b5ba-b7daab220e9f" released by "delete_volume" :: held 0.991s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:52 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cb0513da-af66-4f7a-8a34-d540ba57089d tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.bae75686-cec0-40e7-bba7-1f524122f7d1" returned: 0 in 0.416s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cb0513da-af66-4f7a-8a34-d540ba57089d tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:52 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.info Apr 15 20:10:52 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Created reservations ['c74cfd2b-230f-4d93-8b68-c08eef60b6e8', '2ff81bfe-bbf7-4707-8e8b-70650cf4fb45', '161c4b55-9f6b-449d-8de9-656786c22322', '600bdb87-6f53-47ad-8ab0-f7ecffa9cab6'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:52 devstack sudo[88307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:10:52 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:53 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cb0513da-af66-4f7a-8a34-d540ba57089d tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.info" returned: 0 in 0.442s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:53 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-cb0513da-af66-4f7a-8a34-d540ba57089d tempest-GroupSnapshotsTest-57414795 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cb0513da-af66-4f7a-8a34-d540ba57089d tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:53 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6e930a33-4a9e-4755-9e46-f8f0d37dbcb9 tempest-CinderUnicodeTest-73517099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.515s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-6e930a33-4a9e-4755-9e46-f8f0d37dbcb9 tempest-CinderUnicodeTest-73517099 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:10:53 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-6e930a33-4a9e-4755-9e46-f8f0d37dbcb9 tempest-CinderUnicodeTest-73517099 None] Deleted volume successfully. Apr 15 20:10:53 devstack sudo[88311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.info Apr 15 20:10:53 devstack sudo[88311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6e930a33-4a9e-4755-9e46-f8f0d37dbcb9 tempest-CinderUnicodeTest-73517099 None] Lock "cinder-ed204acf-eb90-424d-a3ef-632e425ef78d-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:53 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.501s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:10:53 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Deleted volume successfully. Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8e8718ea-cfdb-4c8b-aea0-381f4146f3b6 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-f372803d-ffc3-419e-b5ba-b7daab220e9f-delete_volume" released by "delete_volume" :: held 7.763s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Flow 'volume_create_manager' (a0bea46f-cd01-40eb-aac5-88c86404ee30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66876f95-cfc4-4ae7-9720-d7636e213891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66876f95-cfc4-4ae7-9720-d7636e213891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1207513738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1d5a7ff97f4bdfbee64c0c0f1ebc9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:54Z,use_quota=True,user_id='13dc60bb0adb445b837963f0956ea59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fc490d-a4dd-4ea6-82ee-a2dd45e2de49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fc490d-a4dd-4ea6-82ee-a2dd45e2de49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a37883e-e7c8-4157-997b-4c6b898d5b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a37883e-e7c8-4157-997b-4c6b898d5b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c', 'volume_name': 'volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5006c5bf-e821-4466-89a1-faec48725048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5006c5bf-e821-4466-89a1-faec48725048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c701db9-ce19-4ba7-afea-2dbcd6620ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:53 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Volume fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c', 'volume_size': 1} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:53 devstack sudo[88311]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cb0513da-af66-4f7a-8a34-d540ba57089d tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.info" returned: 0 in 0.497s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cb0513da-af66-4f7a-8a34-d540ba57089d tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.817s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.155s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1207513738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1d5a7ff97f4bdfbee64c0c0f1ebc9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:10:54Z,use_quota=True,user_id='13dc60bb0adb445b837963f0956ea59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Creating volume fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:10:53 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:10:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:53 devstack sudo[88316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c 1073741824 Apr 15 20:10:53 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:53 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-cb0513da-af66-4f7a-8a34-d540ba57089d tempest-GroupSnapshotsTest-57414795 None] group_snapshot db557058-11c5-4cc0-b355-0c68b03ab3e7: created successfully Apr 15 20:10:54 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-a11ed314-6f85-48c1-ab6e-69470a501249 tempest-GroupSnapshotsTest-57414795 None] group_snapshot db557058-11c5-4cc0-b355-0c68b03ab3e7: deleting Apr 15 20:10:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-a11ed314-6f85-48c1-ab6e-69470a501249 tempest-GroupSnapshotsTest-57414795 None] group_snapshot db557058-11c5-4cc0-b355-0c68b03ab3e7: deleting {{(pid=82989) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 20:10:54 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a11ed314-6f85-48c1-ab6e-69470a501249 tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "cinder-quobyte-81e8777a-97fa-4765-b3fa-afd71703851c" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:54 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a11ed314-6f85-48c1-ab6e-69470a501249 tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-81e8777a-97fa-4765-b3fa-afd71703851c" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:54 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a11ed314-6f85-48c1-ab6e-69470a501249 tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "cinder-quobyte-bae75686-cec0-40e7-bba7-1f524122f7d1" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:54 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a11ed314-6f85-48c1-ab6e-69470a501249 tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-bae75686-cec0-40e7-bba7-1f524122f7d1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:54 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-a11ed314-6f85-48c1-ab6e-69470a501249 tempest-GroupSnapshotsTest-57414795 None] Deleting offline snapshot bae75686-cec0-40e7-bba7-1f524122f7d1 of volume 81e8777a-97fa-4765-b3fa-afd71703851c {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:10:54 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-a11ed314-6f85-48c1-ab6e-69470a501249 tempest-GroupSnapshotsTest-57414795 None] snapshot_file for this snap is: volume-81e8777a-97fa-4765-b3fa-afd71703851c.bae75686-cec0-40e7-bba7-1f524122f7d1 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:10:54 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[efad758c-4103-492d-a0cc-9369e3111362]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a11ed314-6f85-48c1-ab6e-69470a501249 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.bae75686-cec0-40e7-bba7-1f524122f7d1 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:54 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c 1073741824" returned: 0 in 0.568s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:54 devstack sudo[88322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c Apr 15 20:10:54 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:54 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.bae75686-cec0-40e7-bba7-1f524122f7d1 Apr 15 20:10:54 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:54 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c" returned: 0 in 0.466s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:54 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:10:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c701db9-ce19-4ba7-afea-2dbcd6620ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700efec9-0249-4ab4-8f5a-e19faf66c276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:10:54 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Volume volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c (fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c): created successfully Apr 15 20:10:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700efec9-0249-4ab4-8f5a-e19faf66c276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:10:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Flow 'volume_create_manager' (a0bea46f-cd01-40eb-aac5-88c86404ee30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:10:54 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-7971e456-81de-4020-912e-21d54b9df7dd tempest-VolumesDeleteCascade-2020113687 None] Created volume successfully. Apr 15 20:10:54 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a11ed314-6f85-48c1-ab6e-69470a501249 tempest-GroupSnapshotsTest-57414795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.bae75686-cec0-40e7-bba7-1f524122f7d1" returned: 0 in 0.562s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:54 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-a11ed314-6f85-48c1-ab6e-69470a501249 tempest-GroupSnapshotsTest-57414795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81e8777a-97fa-4765-b3fa-afd71703851c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:10:54 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[590bfa8c-cb82-4a84-9630-067c8db9b48b]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a11ed314-6f85-48c1-ab6e-69470a501249 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:54 devstack sudo[88329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c Apr 15 20:10:54 devstack sudo[88329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:55 devstack sudo[88329]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a11ed314-6f85-48c1-ab6e-69470a501249 tempest-GroupSnapshotsTest-57414795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c" returned: 0 in 0.546s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a11ed314-6f85-48c1-ab6e-69470a501249 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.bae75686-cec0-40e7-bba7-1f524122f7d1 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:55 devstack sudo[88336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.bae75686-cec0-40e7-bba7-1f524122f7d1 Apr 15 20:10:55 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9448acad-38ff-4212-a954-316f124e126e tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9448acad-38ff-4212-a954-316f124e126e tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-9448acad-38ff-4212-a954-316f124e126e tempest-VolumesDeleteCascade-2020113687 None] Creating offline snapshot c09d0934-554e-4f27-9597-5b73e5327cd5 of volume fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:10:55 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[c273c3eb-0362-4f4f-a525-2227271bfab0]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9448acad-38ff-4212-a954-316f124e126e tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:55 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c Apr 15 20:10:55 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:55 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a11ed314-6f85-48c1-ab6e-69470a501249 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.bae75686-cec0-40e7-bba7-1f524122f7d1" returned: 0 in 0.479s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a11ed314-6f85-48c1-ab6e-69470a501249 tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.bae75686-cec0-40e7-bba7-1f524122f7d1 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:55 devstack sudo[88343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.bae75686-cec0-40e7-bba7-1f524122f7d1 Apr 15 20:10:55 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:56 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9448acad-38ff-4212-a954-316f124e126e tempest-VolumesDeleteCascade-2020113687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c" returned: 0 in 0.530s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9448acad-38ff-4212-a954-316f124e126e tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.c09d0934-554e-4f27-9597-5b73e5327cd5 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:56 devstack sudo[88349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.c09d0934-554e-4f27-9597-5b73e5327cd5 1G Apr 15 20:10:56 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:56 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a11ed314-6f85-48c1-ab6e-69470a501249 tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c.bae75686-cec0-40e7-bba7-1f524122f7d1" returned: 0 in 0.421s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:56 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a11ed314-6f85-48c1-ab6e-69470a501249 tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-bae75686-cec0-40e7-bba7-1f524122f7d1" released by "_delete_snapshot" :: held 2.067s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:56 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a11ed314-6f85-48c1-ab6e-69470a501249 tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-81e8777a-97fa-4765-b3fa-afd71703851c" released by "delete_snapshot" :: held 2.093s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:56 devstack cinder-volume[82989]: WARNING cinder.quota [None req-a11ed314-6f85-48c1-ab6e-69470a501249 tempest-GroupSnapshotsTest-57414795 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1251095051 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1251095051, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:10:56 devstack cinder-volume[82989]: WARNING cinder.quota [None req-a11ed314-6f85-48c1-ab6e-69470a501249 tempest-GroupSnapshotsTest-57414795 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1251095051 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1251095051, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:10:56 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-a11ed314-6f85-48c1-ab6e-69470a501249 tempest-GroupSnapshotsTest-57414795 None] Created reservations ['8bd9f70f-66c8-4676-aa77-dea51e8e4984', '8e99d7fe-49e0-4a50-ae07-926bcc0f0850', '949bb578-975d-4256-bad5-1ab5d01c2533', 'a26d2587-75d9-4102-91cc-ea271db87b6d'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:56 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-a11ed314-6f85-48c1-ab6e-69470a501249 tempest-GroupSnapshotsTest-57414795 None] group_snapshot db557058-11c5-4cc0-b355-0c68b03ab3e7: deleted successfully Apr 15 20:10:56 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9448acad-38ff-4212-a954-316f124e126e tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.c09d0934-554e-4f27-9597-5b73e5327cd5 1G" returned: 0 in 0.553s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9448acad-38ff-4212-a954-316f124e126e tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.c09d0934-554e-4f27-9597-5b73e5327cd5 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:56 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.c09d0934-554e-4f27-9597-5b73e5327cd5 Apr 15 20:10:56 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:57 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9448acad-38ff-4212-a954-316f124e126e tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.c09d0934-554e-4f27-9597-5b73e5327cd5" returned: 0 in 0.433s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:57 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-9448acad-38ff-4212-a954-316f124e126e tempest-VolumesDeleteCascade-2020113687 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.c09d0934-554e-4f27-9597-5b73e5327cd5 is being set with open permissions: ugo+rw Apr 15 20:10:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9448acad-38ff-4212-a954-316f124e126e tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.c09d0934-554e-4f27-9597-5b73e5327cd5 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:57 devstack sudo[88359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.c09d0934-554e-4f27-9597-5b73e5327cd5 Apr 15 20:10:57 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:57 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cdbe3bb1-9dc6-4b25-9c8d-aab524a0c23c tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "cinder-quobyte-81e8777a-97fa-4765-b3fa-afd71703851c" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:10:57 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cdbe3bb1-9dc6-4b25-9c8d-aab524a0c23c tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-81e8777a-97fa-4765-b3fa-afd71703851c" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:10:57 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[790aec22-2c6d-438c-bb4d-4d9c9efe1fba]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:10:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cdbe3bb1-9dc6-4b25-9c8d-aab524a0c23c tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:57 devstack sudo[88361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c Apr 15 20:10:57 devstack sudo[88361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:57 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9448acad-38ff-4212-a954-316f124e126e tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.c09d0934-554e-4f27-9597-5b73e5327cd5" returned: 0 in 0.578s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9448acad-38ff-4212-a954-316f124e126e tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:57 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.info Apr 15 20:10:57 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:58 devstack sudo[88361]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cdbe3bb1-9dc6-4b25-9c8d-aab524a0c23c tempest-GroupSnapshotsTest-57414795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c" returned: 0 in 0.506s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cdbe3bb1-9dc6-4b25-9c8d-aab524a0c23c tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:58 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c Apr 15 20:10:58 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:58 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9448acad-38ff-4212-a954-316f124e126e tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.info" returned: 0 in 0.436s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:58 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-9448acad-38ff-4212-a954-316f124e126e tempest-VolumesDeleteCascade-2020113687 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.info is being set with open permissions: ugo+rw Apr 15 20:10:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9448acad-38ff-4212-a954-316f124e126e tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:58 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.info Apr 15 20:10:58 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:58 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cdbe3bb1-9dc6-4b25-9c8d-aab524a0c23c tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-81e8777a-97fa-4765-b3fa-afd71703851c" returned: 0 in 0.470s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:58 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cdbe3bb1-9dc6-4b25-9c8d-aab524a0c23c tempest-GroupSnapshotsTest-57414795 None] Lock "cinder-quobyte-81e8777a-97fa-4765-b3fa-afd71703851c" released by "delete_volume" :: held 1.010s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:10:58 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-cdbe3bb1-9dc6-4b25-9c8d-aab524a0c23c tempest-GroupSnapshotsTest-57414795 None] Created reservations ['05617b2f-9e4c-4af9-987d-781b96283e51'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:58 devstack cinder-volume[82989]: WARNING cinder.quota [None req-cdbe3bb1-9dc6-4b25-9c8d-aab524a0c23c tempest-GroupSnapshotsTest-57414795 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1251095051 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1251095051, it is now deprecated. Please use the default quota class for default quota. Apr 15 20:10:58 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-cdbe3bb1-9dc6-4b25-9c8d-aab524a0c23c tempest-GroupSnapshotsTest-57414795 None] Created reservations ['06f107e9-9108-4f3d-9fe5-5f569c4705da', '5c352394-4934-476f-b89d-bb962af357d8', 'f7f232e8-b22a-415f-9fa9-41692af91d32', 'f2c25b5f-c821-4602-81d3-2a5fae8efbb6'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:10:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cdbe3bb1-9dc6-4b25-9c8d-aab524a0c23c tempest-GroupSnapshotsTest-57414795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:10:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cdbe3bb1-9dc6-4b25-9c8d-aab524a0c23c tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:10:58 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-cdbe3bb1-9dc6-4b25-9c8d-aab524a0c23c tempest-GroupSnapshotsTest-57414795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:10:58 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-cdbe3bb1-9dc6-4b25-9c8d-aab524a0c23c tempest-GroupSnapshotsTest-57414795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:10:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cdbe3bb1-9dc6-4b25-9c8d-aab524a0c23c tempest-GroupSnapshotsTest-57414795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cdbe3bb1-9dc6-4b25-9c8d-aab524a0c23c tempest-GroupSnapshotsTest-57414795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:10:58 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:10:58 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:10:58 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9448acad-38ff-4212-a954-316f124e126e tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.info" returned: 0 in 0.602s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9448acad-38ff-4212-a954-316f124e126e tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.183s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:10:58 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-9448acad-38ff-4212-a954-316f124e126e tempest-VolumesDeleteCascade-2020113687 None] Create snapshot completed successfully Apr 15 20:10:59 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Apr 15 20:10:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cdbe3bb1-9dc6-4b25-9c8d-aab524a0c23c tempest-GroupSnapshotsTest-57414795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.447s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:10:59 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-cdbe3bb1-9dc6-4b25-9c8d-aab524a0c23c tempest-GroupSnapshotsTest-57414795 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:10:59 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-cdbe3bb1-9dc6-4b25-9c8d-aab524a0c23c tempest-GroupSnapshotsTest-57414795 None] Delete group completed successfully. Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Flow 'volume_create_manager' (2cfe1c7e-bb63-4865-bf23-37541009ff94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da579b95-0319-4c21-b393-eb09dcb52037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da579b95-0319-4c21-b393-eb09dcb52037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-387070064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d68c12-b1c9-4d8e-a284-b5942cf8cc54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1d5a7ff97f4bdfbee64c0c0f1ebc9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c09d0934-554e-4f27-9597-5b73e5327cd5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:00Z,use_quota=True,user_id='13dc60bb0adb445b837963f0956ea59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be6d4ba3-2319-4c33-bd1c-094d18aab70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be6d4ba3-2319-4c33-bd1c-094d18aab70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1a635a-1e02-45f7-a58d-d2a1da89aca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1a635a-1e02-45f7-a58d-d2a1da89aca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e3d68c12-b1c9-4d8e-a284-b5942cf8cc54', 'volume_name': 'volume-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54', 'volume_size': 1, 'snapshot_id': 'c09d0934-554e-4f27-9597-5b73e5327cd5'}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfce67f2-7364-462d-90a6-69a068d52fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfce67f2-7364-462d-90a6-69a068d52fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eda59e6-385c-4d75-b070-ece120e77042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:00 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Volume e3d68c12-b1c9-4d8e-a284-b5942cf8cc54: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54', 'volume_size': 1, 'snapshot_id': 'c09d0934-554e-4f27-9597-5b73e5327cd5'} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "cinder-quobyte-c09d0934-554e-4f27-9597-5b73e5327cd5-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54" by "_create_volume_from_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-quobyte-c09d0934-554e-4f27-9597-5b73e5327cd5-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Creating volume e3d68c12-b1c9-4d8e-a284-b5942cf8cc54 from snapshot c09d0934-554e-4f27-9597-5b73e5327cd5 {{(pid=82989) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "cinder-quobyte-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54" by "_copy_volume_from_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-quobyte-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] snapshot: c09d0934-554e-4f27-9597-5b73e5327cd5, volume: e3d68c12-b1c9-4d8e-a284-b5942cf8cc54, {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cd6a09-2a50-4b91-9c44-9cd883ba3376]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.c09d0934-554e-4f27-9597-5b73e5327cd5 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:00 devstack sudo[88379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.c09d0934-554e-4f27-9597-5b73e5327cd5 Apr 15 20:11:00 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:00 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.c09d0934-554e-4f27-9597-5b73e5327cd5" returned: 0 in 0.577s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Creating direct copy from snapshot {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[3615b8a3-9d15-4e62-ae3b-5bed835b0fd0]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:01 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c Apr 15 20:11:01 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:01 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c" returned: 0 in 0.678s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:01 devstack cinder-volume[82989]: DEBUG cinder.utils [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Path /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54 not found in is_blk_device check {{(pid=82989) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 20:11:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:01 devstack sudo[88395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54 Apr 15 20:11:01 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:03 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54" returned: 0 in 2.325s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:03 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9476d7e-433f-45d5-8b6b-07e8a3329436]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:04 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c Apr 15 20:11:04 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:04 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:11:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Flow 'volume_create_manager' (a7fa7350-09de-434b-966c-d46a3b5ef9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:11:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a645ffd-3c64-4e38-b278-ca198bca4be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a645ffd-3c64-4e38-b278-ca198bca4be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-490650128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c01dec-bf67-4ef0-88e4-d0a734714d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74f6857381d9498484b8ede5af3ecec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:04Z,use_quota=True,user_id='4cb2a0ad063e416ea93af106c7db94f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87fd3292-c93f-4f4a-8820-b84f909e6f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87fd3292-c93f-4f4a-8820-b84f909e6f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572a74cc-346c-41c2-9641-f9943210fb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572a74cc-346c-41c2-9641-f9943210fb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3c01dec-bf67-4ef0-88e4-d0a734714d59', 'volume_name': 'volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18db784d-69dc-4192-8bc3-9033bc510dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18db784d-69dc-4192-8bc3-9033bc510dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcecda9a-f347-4ab7-bbee-e1c69b5b32d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:04 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Volume c3c01dec-bf67-4ef0-88e4-d0a734714d59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59', 'volume_size': 1} Apr 15 20:11:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:04 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c" returned: 0 in 0.679s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:04 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c, size 1024.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54 {{(pid=82989) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 20:11:04 devstack cinder-volume[82989]: INFO cinder.image.image_utils [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Converted 1024.00 MB image at 440.23 MB/s Apr 15 20:11:04 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54 is being set with open permissions: ugo+rw Apr 15 20:11:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:04 devstack sudo[88413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54 Apr 15 20:11:04 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:05 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54" returned: 0 in 0.491s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-quobyte-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54" released by "_copy_volume_from_snapshot" :: held 4.806s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-quobyte-c09d0934-554e-4f27-9597-5b73e5327cd5-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54" released by "_create_volume_from_snapshot" :: held 4.824s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.832s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.728s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-490650128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c01dec-bf67-4ef0-88e4-d0a734714d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74f6857381d9498484b8ede5af3ecec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:04Z,use_quota=True,user_id='4cb2a0ad063e416ea93af106c7db94f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Creating volume c3c01dec-bf67-4ef0-88e4-d0a734714d59 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:11:05 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:05 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59 1073741824 Apr 15 20:11:05 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eda59e6-385c-4d75-b070-ece120e77042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54', 'volume_size': 1, 'snapshot_id': 'c09d0934-554e-4f27-9597-5b73e5327cd5'}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be6dc1c1-4403-46fd-92ec-8ae9b191885b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:05 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Volume volume-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54 (e3d68c12-b1c9-4d8e-a284-b5942cf8cc54): created successfully Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be6dc1c1-4403-46fd-92ec-8ae9b191885b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Flow 'volume_create_manager' (2cfe1c7e-bb63-4865-bf23-37541009ff94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:11:05 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-335b5223-dc31-4db6-849f-f92da0297512 tempest-VolumesDeleteCascade-2020113687 None] Created volume successfully. Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "cinder-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Performing cascade delete. {{(pid=82989) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "cinder-c09d0934-554e-4f27-9597-5b73e5327cd5-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:05 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59 1073741824" returned: 0 in 0.539s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-c09d0934-554e-4f27-9597-5b73e5327cd5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "cinder-quobyte-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-quobyte-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "cinder-quobyte-c09d0934-554e-4f27-9597-5b73e5327cd5" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-quobyte-c09d0934-554e-4f27-9597-5b73e5327cd5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Deleting offline snapshot c09d0934-554e-4f27-9597-5b73e5327cd5 of volume fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] snapshot_file for this snap is: volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.c09d0934-554e-4f27-9597-5b73e5327cd5 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:11:05 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59 Apr 15 20:11:05 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[d380c1ce-e319-431f-95bf-cba472dd84e2]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.c09d0934-554e-4f27-9597-5b73e5327cd5 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:05 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.c09d0934-554e-4f27-9597-5b73e5327cd5 Apr 15 20:11:05 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:06 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59" returned: 0 in 0.435s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:06 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:11:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:06 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcecda9a-f347-4ab7-bbee-e1c69b5b32d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:06 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab50d75-9b92-4a36-9e16-1636b1876d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:06 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Volume volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59 (c3c01dec-bf67-4ef0-88e4-d0a734714d59): created successfully Apr 15 20:11:06 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab50d75-9b92-4a36-9e16-1636b1876d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:06 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Flow 'volume_create_manager' (a7fa7350-09de-434b-966c-d46a3b5ef9d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:11:06 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-bfb96995-aa9c-4950-a7ad-e233e3a02139 tempest-SnapshotsActionsTest-642137088 None] Created volume successfully. Apr 15 20:11:06 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.c09d0934-554e-4f27-9597-5b73e5327cd5" returned: 0 in 0.484s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:06 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:11:06 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ea1db2-720a-4974-9e49-74bbf7ef51c9]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:06 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c Apr 15 20:11:06 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-6ee17316-a63d-40e5-a29f-5bc4c7427766 tempest-SnapshotsActionsTest-642137088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-6ee17316-a63d-40e5-a29f-5bc4c7427766 tempest-SnapshotsActionsTest-642137088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:06 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-6ee17316-a63d-40e5-a29f-5bc4c7427766 tempest-SnapshotsActionsTest-642137088 None] Creating offline snapshot 92164d9d-00c5-4941-bf21-0a0960f2ae74 of volume c3c01dec-bf67-4ef0-88e4-d0a734714d59 {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:11:06 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[7631b0eb-1586-4961-af00-69ac45b271fb]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6ee17316-a63d-40e5-a29f-5bc4c7427766 tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:06 devstack sudo[88431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59 Apr 15 20:11:06 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:06 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c" returned: 0 in 0.569s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.c09d0934-554e-4f27-9597-5b73e5327cd5 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:06 devstack sudo[88436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.c09d0934-554e-4f27-9597-5b73e5327cd5 Apr 15 20:11:06 devstack sudo[88436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:07 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6ee17316-a63d-40e5-a29f-5bc4c7427766 tempest-SnapshotsActionsTest-642137088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59" returned: 0 in 0.539s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6ee17316-a63d-40e5-a29f-5bc4c7427766 tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:07 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 1G Apr 15 20:11:07 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:07 devstack sudo[88436]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.c09d0934-554e-4f27-9597-5b73e5327cd5" returned: 0 in 0.532s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.c09d0934-554e-4f27-9597-5b73e5327cd5 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:07 devstack sudo[88446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.c09d0934-554e-4f27-9597-5b73e5327cd5 Apr 15 20:11:07 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:07 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6ee17316-a63d-40e5-a29f-5bc4c7427766 tempest-SnapshotsActionsTest-642137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 1G" returned: 0 in 0.571s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6ee17316-a63d-40e5-a29f-5bc4c7427766 tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:07 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 Apr 15 20:11:07 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:07 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c.c09d0934-554e-4f27-9597-5b73e5327cd5" returned: 0 in 0.501s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:07 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-quobyte-c09d0934-554e-4f27-9597-5b73e5327cd5" released by "_delete_snapshot" :: held 2.150s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:07 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-quobyte-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c" released by "delete_snapshot" :: held 2.174s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:08 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Created reservations ['d007ac71-b9a4-44c0-8e5a-ca44091a3c0c', '472b2a71-de5a-47b5-9164-d0d6ec3a98f3', '7ad0458c-09a6-4b57-b376-1098070f9da2', '310513e6-48d2-461e-bff2-bad8c6683aa0'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:11:08 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Delete snapshot completed successfully. Apr 15 20:11:08 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-c09d0934-554e-4f27-9597-5b73e5327cd5-delete_snapshot" released by "delete_snapshot" :: held 2.310s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:08 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Snapshots deleted, issuing volume delete {{(pid=82989) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 15 20:11:08 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "cinder-quobyte-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:08 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-quobyte-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c" acquired by "delete_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:08 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[074fd9ab-94e5-497b-a092-fe9643981f11]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:08 devstack sudo[88454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c Apr 15 20:11:08 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:08 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6ee17316-a63d-40e5-a29f-5bc4c7427766 tempest-SnapshotsActionsTest-642137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74" returned: 0 in 0.481s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:08 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-6ee17316-a63d-40e5-a29f-5bc4c7427766 tempest-SnapshotsActionsTest-642137088 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 is being set with open permissions: ugo+rw Apr 15 20:11:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6ee17316-a63d-40e5-a29f-5bc4c7427766 tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:08 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 Apr 15 20:11:08 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:08 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c" returned: 0 in 0.601s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:08 devstack sudo[88496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c Apr 15 20:11:08 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:08 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6ee17316-a63d-40e5-a29f-5bc4c7427766 tempest-SnapshotsActionsTest-642137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74" returned: 0 in 0.668s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6ee17316-a63d-40e5-a29f-5bc4c7427766 tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:08 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.info Apr 15 20:11:08 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Flow 'volume_create_manager' (f4039aba-74e7-45bf-8951-69227be97bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3414d7-08d2-4223-aeec-def88c79ad57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3414d7-08d2-4223-aeec-def88c79ad57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1743811199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b34f108-2fe9-44f5-8baa-af9302b9eae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc9890bcd794b3eb7c58608c092e1d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:09Z,use_quota=True,user_id='71ac02311cff46f6a9d645e86f13b6ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce75c97-33fe-4ff7-a535-2e50a70078a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce75c97-33fe-4ff7-a535-2e50a70078a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (643a95ca-a2a8-4d33-be20-e70c693e91e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (643a95ca-a2a8-4d33-be20-e70c693e91e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b34f108-2fe9-44f5-8baa-af9302b9eae5', 'volume_name': 'volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c597acd1-37d5-4de9-ba10-fd8f476c7266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:09 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c597acd1-37d5-4de9-ba10-fd8f476c7266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9e8fa3-1cfe-41c6-802a-066d739f8d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:09 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Volume 8b34f108-2fe9-44f5-8baa-af9302b9eae5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5', 'volume_size': 1} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c" returned: 0 in 0.509s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-quobyte-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c" released by "delete_volume" :: held 1.138s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Created reservations ['edfeaf17-66d1-4338-b325-5cc01228c36e', '4e0c4558-d960-4aaf-8ff4-25fe538f6aa9', '3fb935d9-c229-404d-a7e9-8971f6e0f96a', '841423e9-e611-4dc5-a849-b1c139f6f9ca'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:09 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:11:09 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:09 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6ee17316-a63d-40e5-a29f-5bc4c7427766 tempest-SnapshotsActionsTest-642137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.info" returned: 0 in 0.502s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:09 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-6ee17316-a63d-40e5-a29f-5bc4c7427766 tempest-SnapshotsActionsTest-642137088 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.info is being set with open permissions: ugo+rw Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6ee17316-a63d-40e5-a29f-5bc4c7427766 tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:09 devstack sudo[88507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.info Apr 15 20:11:09 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:09 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.402s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:11:09 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Deleted volume successfully. Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-81f32020-a5bf-43d5-a059-99262d31d400 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-fc8634d8-020f-4ddf-b6f1-2039bb5c1b8c-delete_volume" released by "delete_volume" :: held 4.005s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:09 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6ee17316-a63d-40e5-a29f-5bc4c7427766 tempest-SnapshotsActionsTest-642137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.info" returned: 0 in 0.390s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-6ee17316-a63d-40e5-a29f-5bc4c7427766 tempest-SnapshotsActionsTest-642137088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.213s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.680s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1743811199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b34f108-2fe9-44f5-8baa-af9302b9eae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc9890bcd794b3eb7c58608c092e1d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:09Z,use_quota=True,user_id='71ac02311cff46f6a9d645e86f13b6ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Creating volume 8b34f108-2fe9-44f5-8baa-af9302b9eae5 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:11:09 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:11:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:09 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 1073741824 Apr 15 20:11:09 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:09 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-6ee17316-a63d-40e5-a29f-5bc4c7427766 tempest-SnapshotsActionsTest-642137088 None] Create snapshot completed successfully Apr 15 20:11:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d16eac2b-f9a3-40c1-943d-85df191e7db0 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "cinder-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d16eac2b-f9a3-40c1-943d-85df191e7db0 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d16eac2b-f9a3-40c1-943d-85df191e7db0 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "cinder-quobyte-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d16eac2b-f9a3-40c1-943d-85df191e7db0 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-quobyte-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54" acquired by "delete_volume" :: waited 0.006s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:10 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[090d6201-642f-4601-89d3-b7f4ad71fc82]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d16eac2b-f9a3-40c1-943d-85df191e7db0 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:10 devstack sudo[88513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54 Apr 15 20:11:10 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:10 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 1073741824" returned: 0 in 0.479s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:10 devstack sudo[88518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 Apr 15 20:11:10 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:10 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d16eac2b-f9a3-40c1-943d-85df191e7db0 tempest-VolumesDeleteCascade-2020113687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54" returned: 0 in 0.470s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d16eac2b-f9a3-40c1-943d-85df191e7db0 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:10 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54 Apr 15 20:11:10 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:10 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5" returned: 0 in 0.390s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:10 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:11:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9e8fa3-1cfe-41c6-802a-066d739f8d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b202a62-980a-4051-a1eb-12b6fc4b82a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:10 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Volume volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 (8b34f108-2fe9-44f5-8baa-af9302b9eae5): created successfully Apr 15 20:11:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b202a62-980a-4051-a1eb-12b6fc4b82a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Flow 'volume_create_manager' (f4039aba-74e7-45bf-8951-69227be97bec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:11:10 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-f840aca3-1c2e-41a1-abc1-640a7372cfb8 tempest-SnapshotDependencyTests-22341852 None] Created volume successfully. Apr 15 20:11:11 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d16eac2b-f9a3-40c1-943d-85df191e7db0 tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54" returned: 0 in 0.404s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:11 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d16eac2b-f9a3-40c1-943d-85df191e7db0 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-quobyte-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54" released by "delete_volume" :: held 0.908s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-317a9abd-79f0-4299-9c50-2365cdb841df tempest-SnapshotsActionsTest-642137088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-317a9abd-79f0-4299-9c50-2365cdb841df tempest-SnapshotsActionsTest-642137088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:11 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-317a9abd-79f0-4299-9c50-2365cdb841df tempest-SnapshotsActionsTest-642137088 None] Creating offline snapshot 15d6bc0e-9e65-436c-8541-acecf66f4509 of volume c3c01dec-bf67-4ef0-88e4-d0a734714d59 {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:11:11 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-d16eac2b-f9a3-40c1-943d-85df191e7db0 tempest-VolumesDeleteCascade-2020113687 None] Created reservations ['d3641a4d-b68c-4ad3-bfd4-ba2b5a6d7c47', '02942849-e4e9-4fef-8b7e-77ea5f7b42e2', '60272dc9-4709-4d7b-8e31-e0d9696a14a1', '68410281-9e1c-432c-80f5-694e696726b1'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:11:11 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f19cb03-b3d3-45fb-9631-f3e767ab496b]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-317a9abd-79f0-4299-9c50-2365cdb841df tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d16eac2b-f9a3-40c1-943d-85df191e7db0 tempest-VolumesDeleteCascade-2020113687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d16eac2b-f9a3-40c1-943d-85df191e7db0 tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:11 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d16eac2b-f9a3-40c1-943d-85df191e7db0 tempest-VolumesDeleteCascade-2020113687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:11:11 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d16eac2b-f9a3-40c1-943d-85df191e7db0 tempest-VolumesDeleteCascade-2020113687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:11:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d16eac2b-f9a3-40c1-943d-85df191e7db0 tempest-VolumesDeleteCascade-2020113687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d16eac2b-f9a3-40c1-943d-85df191e7db0 tempest-VolumesDeleteCascade-2020113687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:11 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 Apr 15 20:11:11 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:11 devstack sudo[88528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:11:11 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-be2e26cb-8ef1-4555-9641-cc5fe3b42f13 tempest-SnapshotDependencyTests-22341852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:11 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-317a9abd-79f0-4299-9c50-2365cdb841df tempest-SnapshotsActionsTest-642137088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74" returned: 0 in 0.553s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:11 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-317a9abd-79f0-4299-9c50-2365cdb841df tempest-SnapshotsActionsTest-642137088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:11:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-317a9abd-79f0-4299-9c50-2365cdb841df tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.15d6bc0e-9e65-436c-8541-acecf66f4509 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:11 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d16eac2b-f9a3-40c1-943d-85df191e7db0 tempest-VolumesDeleteCascade-2020113687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.520s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:11 devstack sudo[88535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.15d6bc0e-9e65-436c-8541-acecf66f4509 1G Apr 15 20:11:11 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-d16eac2b-f9a3-40c1-943d-85df191e7db0 tempest-VolumesDeleteCascade-2020113687 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:11:11 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:11 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-d16eac2b-f9a3-40c1-943d-85df191e7db0 tempest-VolumesDeleteCascade-2020113687 None] Deleted volume successfully. Apr 15 20:11:11 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d16eac2b-f9a3-40c1-943d-85df191e7db0 tempest-VolumesDeleteCascade-2020113687 None] Lock "cinder-e3d68c12-b1c9-4d8e-a284-b5942cf8cc54-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:12 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-317a9abd-79f0-4299-9c50-2365cdb841df tempest-SnapshotsActionsTest-642137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.15d6bc0e-9e65-436c-8541-acecf66f4509 1G" returned: 0 in 0.549s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-317a9abd-79f0-4299-9c50-2365cdb841df tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.15d6bc0e-9e65-436c-8541-acecf66f4509 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:12 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.15d6bc0e-9e65-436c-8541-acecf66f4509 Apr 15 20:11:12 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:12 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-317a9abd-79f0-4299-9c50-2365cdb841df tempest-SnapshotsActionsTest-642137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.15d6bc0e-9e65-436c-8541-acecf66f4509" returned: 0 in 0.477s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:12 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-317a9abd-79f0-4299-9c50-2365cdb841df tempest-SnapshotsActionsTest-642137088 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.15d6bc0e-9e65-436c-8541-acecf66f4509 is being set with open permissions: ugo+rw Apr 15 20:11:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-317a9abd-79f0-4299-9c50-2365cdb841df tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.15d6bc0e-9e65-436c-8541-acecf66f4509 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:12 devstack sudo[88546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.15d6bc0e-9e65-436c-8541-acecf66f4509 Apr 15 20:11:12 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:13 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-317a9abd-79f0-4299-9c50-2365cdb841df tempest-SnapshotsActionsTest-642137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.15d6bc0e-9e65-436c-8541-acecf66f4509" returned: 0 in 0.432s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-317a9abd-79f0-4299-9c50-2365cdb841df tempest-SnapshotsActionsTest-642137088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.078s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-be2e26cb-8ef1-4555-9641-cc5fe3b42f13 tempest-SnapshotDependencyTests-22341852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.676s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:13 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-be2e26cb-8ef1-4555-9641-cc5fe3b42f13 tempest-SnapshotDependencyTests-22341852 None] Creating offline snapshot 87702c1f-ceeb-4691-aa80-0e99dc83581f of volume 8b34f108-2fe9-44f5-8baa-af9302b9eae5 {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:11:13 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64af850-affd-4bfb-bafb-7a15ba41e5f7]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-be2e26cb-8ef1-4555-9641-cc5fe3b42f13 tempest-SnapshotDependencyTests-22341852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:13 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-317a9abd-79f0-4299-9c50-2365cdb841df tempest-SnapshotsActionsTest-642137088 None] Create snapshot completed successfully Apr 15 20:11:13 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 Apr 15 20:11:13 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:13 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-be2e26cb-8ef1-4555-9641-cc5fe3b42f13 tempest-SnapshotDependencyTests-22341852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5" returned: 0 in 0.507s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-be2e26cb-8ef1-4555-9641-cc5fe3b42f13 tempest-SnapshotDependencyTests-22341852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.87702c1f-ceeb-4691-aa80-0e99dc83581f 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:13 devstack sudo[88554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.87702c1f-ceeb-4691-aa80-0e99dc83581f 1G Apr 15 20:11:13 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:14 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-be2e26cb-8ef1-4555-9641-cc5fe3b42f13 tempest-SnapshotDependencyTests-22341852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.87702c1f-ceeb-4691-aa80-0e99dc83581f 1G" returned: 0 in 0.504s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-be2e26cb-8ef1-4555-9641-cc5fe3b42f13 tempest-SnapshotDependencyTests-22341852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.87702c1f-ceeb-4691-aa80-0e99dc83581f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:14 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.87702c1f-ceeb-4691-aa80-0e99dc83581f Apr 15 20:11:14 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:14 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f791e022-abd9-4b45-994c-abca69b00d27 tempest-SnapshotsActionsTest-798556426 None] Acquiring lock "cinder-15d6bc0e-9e65-436c-8541-acecf66f4509-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:14 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f791e022-abd9-4b45-994c-abca69b00d27 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-15d6bc0e-9e65-436c-8541-acecf66f4509-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:14 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f791e022-abd9-4b45-994c-abca69b00d27 tempest-SnapshotsActionsTest-798556426 None] Acquiring lock "cinder-quobyte-c3c01dec-bf67-4ef0-88e4-d0a734714d59" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:14 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f791e022-abd9-4b45-994c-abca69b00d27 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-quobyte-c3c01dec-bf67-4ef0-88e4-d0a734714d59" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:14 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f791e022-abd9-4b45-994c-abca69b00d27 tempest-SnapshotsActionsTest-798556426 None] Acquiring lock "cinder-quobyte-15d6bc0e-9e65-436c-8541-acecf66f4509" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:14 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f791e022-abd9-4b45-994c-abca69b00d27 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-quobyte-15d6bc0e-9e65-436c-8541-acecf66f4509" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-f791e022-abd9-4b45-994c-abca69b00d27 tempest-SnapshotsActionsTest-798556426 None] Deleting offline snapshot 15d6bc0e-9e65-436c-8541-acecf66f4509 of volume c3c01dec-bf67-4ef0-88e4-d0a734714d59 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:11:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-f791e022-abd9-4b45-994c-abca69b00d27 tempest-SnapshotsActionsTest-798556426 None] snapshot_file for this snap is: volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.15d6bc0e-9e65-436c-8541-acecf66f4509 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:11:14 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f4831d-126c-410b-b489-c44d6cb31d5f]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f791e022-abd9-4b45-994c-abca69b00d27 tempest-SnapshotsActionsTest-798556426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.15d6bc0e-9e65-436c-8541-acecf66f4509 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:14 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.15d6bc0e-9e65-436c-8541-acecf66f4509 Apr 15 20:11:14 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:14 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-be2e26cb-8ef1-4555-9641-cc5fe3b42f13 tempest-SnapshotDependencyTests-22341852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.87702c1f-ceeb-4691-aa80-0e99dc83581f" returned: 0 in 0.464s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:14 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-be2e26cb-8ef1-4555-9641-cc5fe3b42f13 tempest-SnapshotDependencyTests-22341852 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.87702c1f-ceeb-4691-aa80-0e99dc83581f is being set with open permissions: ugo+rw Apr 15 20:11:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-be2e26cb-8ef1-4555-9641-cc5fe3b42f13 tempest-SnapshotDependencyTests-22341852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.87702c1f-ceeb-4691-aa80-0e99dc83581f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:14 devstack sudo[88566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.87702c1f-ceeb-4691-aa80-0e99dc83581f Apr 15 20:11:14 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:14 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f791e022-abd9-4b45-994c-abca69b00d27 tempest-SnapshotsActionsTest-798556426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.15d6bc0e-9e65-436c-8541-acecf66f4509" returned: 0 in 0.583s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-f791e022-abd9-4b45-994c-abca69b00d27 tempest-SnapshotsActionsTest-798556426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:11:14 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[e351670f-1bb4-4370-967b-d7764b4ff422]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f791e022-abd9-4b45-994c-abca69b00d27 tempest-SnapshotsActionsTest-798556426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:14 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 Apr 15 20:11:14 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:15 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-be2e26cb-8ef1-4555-9641-cc5fe3b42f13 tempest-SnapshotDependencyTests-22341852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.87702c1f-ceeb-4691-aa80-0e99dc83581f" returned: 0 in 0.497s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-be2e26cb-8ef1-4555-9641-cc5fe3b42f13 tempest-SnapshotDependencyTests-22341852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:15 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.info Apr 15 20:11:15 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:15 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f791e022-abd9-4b45-994c-abca69b00d27 tempest-SnapshotsActionsTest-798556426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74" returned: 0 in 0.569s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-f791e022-abd9-4b45-994c-abca69b00d27 tempest-SnapshotsActionsTest-798556426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:11:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f791e022-abd9-4b45-994c-abca69b00d27 tempest-SnapshotsActionsTest-798556426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.15d6bc0e-9e65-436c-8541-acecf66f4509 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:15 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.15d6bc0e-9e65-436c-8541-acecf66f4509 Apr 15 20:11:15 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:15 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-be2e26cb-8ef1-4555-9641-cc5fe3b42f13 tempest-SnapshotDependencyTests-22341852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.info" returned: 0 in 0.464s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:15 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-be2e26cb-8ef1-4555-9641-cc5fe3b42f13 tempest-SnapshotDependencyTests-22341852 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.info is being set with open permissions: ugo+rw Apr 15 20:11:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-be2e26cb-8ef1-4555-9641-cc5fe3b42f13 tempest-SnapshotDependencyTests-22341852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:15 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.info Apr 15 20:11:15 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:15 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f791e022-abd9-4b45-994c-abca69b00d27 tempest-SnapshotsActionsTest-798556426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.15d6bc0e-9e65-436c-8541-acecf66f4509" returned: 0 in 0.503s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f791e022-abd9-4b45-994c-abca69b00d27 tempest-SnapshotsActionsTest-798556426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.15d6bc0e-9e65-436c-8541-acecf66f4509 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:16 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.15d6bc0e-9e65-436c-8541-acecf66f4509 Apr 15 20:11:16 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:16 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-be2e26cb-8ef1-4555-9641-cc5fe3b42f13 tempest-SnapshotDependencyTests-22341852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.info" returned: 0 in 0.523s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-be2e26cb-8ef1-4555-9641-cc5fe3b42f13 tempest-SnapshotDependencyTests-22341852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.047s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:16 devstack cinder-volume[82989]: DEBUG dbcounter [-] [82989] Writing DB stats cinder:SELECT=219,cinder:UPDATE=265,cinder:INSERT=66,cinder:DELETE=15 {{(pid=82989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:11:16 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-be2e26cb-8ef1-4555-9641-cc5fe3b42f13 tempest-SnapshotDependencyTests-22341852 None] Create snapshot completed successfully Apr 15 20:11:16 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f791e022-abd9-4b45-994c-abca69b00d27 tempest-SnapshotsActionsTest-798556426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.15d6bc0e-9e65-436c-8541-acecf66f4509" returned: 0 in 0.509s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:16 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f791e022-abd9-4b45-994c-abca69b00d27 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-quobyte-15d6bc0e-9e65-436c-8541-acecf66f4509" released by "_delete_snapshot" :: held 2.216s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:16 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f791e022-abd9-4b45-994c-abca69b00d27 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-quobyte-c3c01dec-bf67-4ef0-88e4-d0a734714d59" released by "delete_snapshot" :: held 2.230s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:16 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-f791e022-abd9-4b45-994c-abca69b00d27 tempest-SnapshotsActionsTest-798556426 None] Created reservations ['c33356ae-f21a-4b08-925f-1589538cbe4a', '90d07cab-769c-4e88-9e73-5ad48b9fa5c2', 'ca5621af-feb4-4f89-8228-eae9d5070e46', '79d8be19-7df0-4477-bbb8-0831f9aa77e3'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:11:16 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-f791e022-abd9-4b45-994c-abca69b00d27 tempest-SnapshotsActionsTest-798556426 None] Delete snapshot completed successfully. Apr 15 20:11:16 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-f791e022-abd9-4b45-994c-abca69b00d27 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-15d6bc0e-9e65-436c-8541-acecf66f4509-delete_snapshot" released by "delete_snapshot" :: held 2.320s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Flow 'volume_create_manager' (dc1390e3-cf00-4594-a545-76d9dcccc777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc456fe1-632d-496a-b4e3-e0f50085705b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc456fe1-632d-496a-b4e3-e0f50085705b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc1d575-073f-4576-a5c5-9f6b59f1107c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc9890bcd794b3eb7c58608c092e1d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=87702c1f-ceeb-4691-aa80-0e99dc83581f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:17Z,use_quota=True,user_id='71ac02311cff46f6a9d645e86f13b6ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5489b6c9-250e-4bdb-b855-7a29c369fa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5489b6c9-250e-4bdb-b855-7a29c369fa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8340c0b-8b2f-4083-908d-766e5df3be83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8340c0b-8b2f-4083-908d-766e5df3be83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7fc1d575-073f-4576-a5c5-9f6b59f1107c', 'volume_name': 'volume-7fc1d575-073f-4576-a5c5-9f6b59f1107c', 'volume_size': 1, 'snapshot_id': '87702c1f-ceeb-4691-aa80-0e99dc83581f'}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9116e2-945a-41f6-a245-9e0720cb2d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9116e2-945a-41f6-a245-9e0720cb2d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df6bb5b-f3b9-4546-81b7-1cd3f2ed66b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:17 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Volume 7fc1d575-073f-4576-a5c5-9f6b59f1107c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7fc1d575-073f-4576-a5c5-9f6b59f1107c', 'volume_size': 1, 'snapshot_id': '87702c1f-ceeb-4691-aa80-0e99dc83581f'} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Acquiring lock "cinder-quobyte-87702c1f-ceeb-4691-aa80-0e99dc83581f-7fc1d575-073f-4576-a5c5-9f6b59f1107c" by "_create_volume_from_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Lock "cinder-quobyte-87702c1f-ceeb-4691-aa80-0e99dc83581f-7fc1d575-073f-4576-a5c5-9f6b59f1107c" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Creating volume 7fc1d575-073f-4576-a5c5-9f6b59f1107c from snapshot 87702c1f-ceeb-4691-aa80-0e99dc83581f {{(pid=82989) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Acquiring lock "cinder-quobyte-7fc1d575-073f-4576-a5c5-9f6b59f1107c" by "_copy_volume_from_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Lock "cinder-quobyte-7fc1d575-073f-4576-a5c5-9f6b59f1107c" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] snapshot: 87702c1f-ceeb-4691-aa80-0e99dc83581f, volume: 7fc1d575-073f-4576-a5c5-9f6b59f1107c, {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4cd8de-6933-4309-a221-59cf05a87513]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.87702c1f-ceeb-4691-aa80-0e99dc83581f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:17 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.87702c1f-ceeb-4691-aa80-0e99dc83581f Apr 15 20:11:17 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-94d1737e-d4c2-4a3c-a5bc-63a3dc6fa752 tempest-SnapshotsActionsTest-642137088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:17 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.87702c1f-ceeb-4691-aa80-0e99dc83581f" returned: 0 in 0.641s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Creating direct copy from snapshot {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51c4bb9-650a-4203-a124-a62c136ac7df]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:17 devstack sudo[88598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 Apr 15 20:11:17 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:18 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5" returned: 0 in 0.497s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:18 devstack cinder-volume[82989]: DEBUG cinder.utils [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Path /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7fc1d575-073f-4576-a5c5-9f6b59f1107c not found in is_blk_device check {{(pid=82989) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 20:11:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7fc1d575-073f-4576-a5c5-9f6b59f1107c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:18 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7fc1d575-073f-4576-a5c5-9f6b59f1107c Apr 15 20:11:18 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:19 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:11:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Flow 'volume_create_manager' (738e76b3-7068-43c9-b589-b269fc5de492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:11:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac6c538-e236-4aa6-b973-5ce8875d0148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac6c538-e236-4aa6-b973-5ce8875d0148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-984675832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310cde1c-2965-46ca-a8b2-60fc5c7c5ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d95dec8b47a4a3ea8a6e1f308eb4e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:20Z,use_quota=True,user_id='cdbe71beac384824be5138ead6dd8daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab3c35da-b980-46db-80dc-327d8df7bd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab3c35da-b980-46db-80dc-327d8df7bd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa16bc07-9313-4bf6-a985-59c811776841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa16bc07-9313-4bf6-a985-59c811776841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '310cde1c-2965-46ca-a8b2-60fc5c7c5ddc', 'volume_name': 'volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9beb3cd-96db-4982-83fa-9ba1a88212d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9beb3cd-96db-4982-83fa-9ba1a88212d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cfff8a9-f5c9-4b73-adae-72042010a61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:20 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Volume 310cde1c-2965-46ca-a8b2-60fc5c7c5ddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc', 'volume_size': 1} Apr 15 20:11:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:20 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7fc1d575-073f-4576-a5c5-9f6b59f1107c" returned: 0 in 2.128s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:20 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[326cb896-15cd-4f0c-8140-ad7e8b90d46f]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:20 devstack sudo[88615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 Apr 15 20:11:20 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:21 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5" returned: 0 in 0.599s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:21 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5, size 1024.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7fc1d575-073f-4576-a5c5-9f6b59f1107c {{(pid=82989) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 20:11:21 devstack cinder-volume[82989]: INFO cinder.image.image_utils [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Converted 1024.00 MB image at 481.08 MB/s Apr 15 20:11:21 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7fc1d575-073f-4576-a5c5-9f6b59f1107c is being set with open permissions: ugo+rw Apr 15 20:11:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7fc1d575-073f-4576-a5c5-9f6b59f1107c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:21 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7fc1d575-073f-4576-a5c5-9f6b59f1107c Apr 15 20:11:21 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:21 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7fc1d575-073f-4576-a5c5-9f6b59f1107c" returned: 0 in 0.401s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:21 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Lock "cinder-quobyte-7fc1d575-073f-4576-a5c5-9f6b59f1107c" released by "_copy_volume_from_snapshot" :: held 4.341s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:21 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Lock "cinder-quobyte-87702c1f-ceeb-4691-aa80-0e99dc83581f-7fc1d575-073f-4576-a5c5-9f6b59f1107c" released by "_create_volume_from_snapshot" :: held 4.366s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.378s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-94d1737e-d4c2-4a3c-a5bc-63a3dc6fa752 tempest-SnapshotsActionsTest-642137088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.826s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-94d1737e-d4c2-4a3c-a5bc-63a3dc6fa752 tempest-SnapshotsActionsTest-642137088 None] Creating offline snapshot b19d96a3-60b0-40fa-9147-544091986aaa of volume c3c01dec-bf67-4ef0-88e4-d0a734714d59 {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:11:21 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae23914-8421-4b70-a35a-467cd78d9fe5]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-94d1737e-d4c2-4a3c-a5bc-63a3dc6fa752 tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df6bb5b-f3b9-4546-81b7-1cd3f2ed66b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fc1d575-073f-4576-a5c5-9f6b59f1107c', 'volume_size': 1, 'snapshot_id': '87702c1f-ceeb-4691-aa80-0e99dc83581f'}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5cf10f-8977-4601-845c-dda811592472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:21 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Volume volume-7fc1d575-073f-4576-a5c5-9f6b59f1107c (7fc1d575-073f-4576-a5c5-9f6b59f1107c): created successfully Apr 15 20:11:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5cf10f-8977-4601-845c-dda811592472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Flow 'volume_create_manager' (dc1390e3-cf00-4594-a545-76d9dcccc777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:11:21 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-7ee5ab51-9fa5-4fc2-aabd-953995f6869c tempest-SnapshotDependencyTests-22341852 None] Created volume successfully. Apr 15 20:11:21 devstack sudo[88623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 Apr 15 20:11:21 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:22 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-94d1737e-d4c2-4a3c-a5bc-63a3dc6fa752 tempest-SnapshotsActionsTest-642137088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74" returned: 0 in 0.488s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:22 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-94d1737e-d4c2-4a3c-a5bc-63a3dc6fa752 tempest-SnapshotsActionsTest-642137088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:11:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-94d1737e-d4c2-4a3c-a5bc-63a3dc6fa752 tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.b19d96a3-60b0-40fa-9147-544091986aaa 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:22 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.b19d96a3-60b0-40fa-9147-544091986aaa 1G Apr 15 20:11:22 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:22 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8a7578e5-ed0a-4007-ba98-f4fded8a459d tempest-SnapshotDependencyTests-22341852 None] Acquiring lock "cinder-87702c1f-ceeb-4691-aa80-0e99dc83581f-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-94d1737e-d4c2-4a3c-a5bc-63a3dc6fa752 tempest-SnapshotsActionsTest-642137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.b19d96a3-60b0-40fa-9147-544091986aaa 1G" returned: 0 in 0.492s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-94d1737e-d4c2-4a3c-a5bc-63a3dc6fa752 tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.b19d96a3-60b0-40fa-9147-544091986aaa {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8a7578e5-ed0a-4007-ba98-f4fded8a459d tempest-SnapshotDependencyTests-22341852 None] Lock "cinder-87702c1f-ceeb-4691-aa80-0e99dc83581f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:22 devstack sudo[88634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.b19d96a3-60b0-40fa-9147-544091986aaa Apr 15 20:11:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8a7578e5-ed0a-4007-ba98-f4fded8a459d tempest-SnapshotDependencyTests-22341852 None] Acquiring lock "cinder-quobyte-8b34f108-2fe9-44f5-8baa-af9302b9eae5" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:22 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8a7578e5-ed0a-4007-ba98-f4fded8a459d tempest-SnapshotDependencyTests-22341852 None] Lock "cinder-quobyte-8b34f108-2fe9-44f5-8baa-af9302b9eae5" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8a7578e5-ed0a-4007-ba98-f4fded8a459d tempest-SnapshotDependencyTests-22341852 None] Acquiring lock "cinder-quobyte-87702c1f-ceeb-4691-aa80-0e99dc83581f" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8a7578e5-ed0a-4007-ba98-f4fded8a459d tempest-SnapshotDependencyTests-22341852 None] Lock "cinder-quobyte-87702c1f-ceeb-4691-aa80-0e99dc83581f" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:22 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-8a7578e5-ed0a-4007-ba98-f4fded8a459d tempest-SnapshotDependencyTests-22341852 None] Deleting offline snapshot 87702c1f-ceeb-4691-aa80-0e99dc83581f of volume 8b34f108-2fe9-44f5-8baa-af9302b9eae5 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:11:22 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-8a7578e5-ed0a-4007-ba98-f4fded8a459d tempest-SnapshotDependencyTests-22341852 None] snapshot_file for this snap is: volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.87702c1f-ceeb-4691-aa80-0e99dc83581f {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:11:22 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a38cb2-3be9-4791-8ea4-2d1a9d01e188]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8a7578e5-ed0a-4007-ba98-f4fded8a459d tempest-SnapshotDependencyTests-22341852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.87702c1f-ceeb-4691-aa80-0e99dc83581f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:22 devstack sudo[88636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.87702c1f-ceeb-4691-aa80-0e99dc83581f Apr 15 20:11:22 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:22 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-94d1737e-d4c2-4a3c-a5bc-63a3dc6fa752 tempest-SnapshotsActionsTest-642137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.b19d96a3-60b0-40fa-9147-544091986aaa" returned: 0 in 0.428s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:22 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-94d1737e-d4c2-4a3c-a5bc-63a3dc6fa752 tempest-SnapshotsActionsTest-642137088 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.b19d96a3-60b0-40fa-9147-544091986aaa is being set with open permissions: ugo+rw Apr 15 20:11:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-94d1737e-d4c2-4a3c-a5bc-63a3dc6fa752 tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.b19d96a3-60b0-40fa-9147-544091986aaa {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:22 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.b19d96a3-60b0-40fa-9147-544091986aaa Apr 15 20:11:22 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:23 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8a7578e5-ed0a-4007-ba98-f4fded8a459d tempest-SnapshotDependencyTests-22341852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.87702c1f-ceeb-4691-aa80-0e99dc83581f" returned: 0 in 0.456s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-8a7578e5-ed0a-4007-ba98-f4fded8a459d tempest-SnapshotDependencyTests-22341852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[258378fa-dd34-4467-b9ae-4501ec0fdf50]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8a7578e5-ed0a-4007-ba98-f4fded8a459d tempest-SnapshotDependencyTests-22341852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:23 devstack sudo[88646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 Apr 15 20:11:23 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:23 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-94d1737e-d4c2-4a3c-a5bc-63a3dc6fa752 tempest-SnapshotsActionsTest-642137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.b19d96a3-60b0-40fa-9147-544091986aaa" returned: 0 in 0.396s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-94d1737e-d4c2-4a3c-a5bc-63a3dc6fa752 tempest-SnapshotsActionsTest-642137088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.860s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.290s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-984675832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310cde1c-2965-46ca-a8b2-60fc5c7c5ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d95dec8b47a4a3ea8a6e1f308eb4e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:20Z,use_quota=True,user_id='cdbe71beac384824be5138ead6dd8daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Creating volume 310cde1c-2965-46ca-a8b2-60fc5c7c5ddc {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:11:23 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:23 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc 1073741824 Apr 15 20:11:23 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:23 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-94d1737e-d4c2-4a3c-a5bc-63a3dc6fa752 tempest-SnapshotsActionsTest-642137088 None] Create snapshot completed successfully Apr 15 20:11:23 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8a7578e5-ed0a-4007-ba98-f4fded8a459d tempest-SnapshotDependencyTests-22341852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5" returned: 0 in 0.459s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8a7578e5-ed0a-4007-ba98-f4fded8a459d tempest-SnapshotDependencyTests-22341852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.87702c1f-ceeb-4691-aa80-0e99dc83581f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:23 devstack sudo[88654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.87702c1f-ceeb-4691-aa80-0e99dc83581f Apr 15 20:11:23 devstack sudo[88654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:23 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc 1073741824" returned: 0 in 0.478s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:23 devstack sudo[88661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc Apr 15 20:11:23 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a3d29989-bdab-4320-a976-a74fd7a9a918 tempest-SnapshotsActionsTest-798556426 None] Acquiring lock "cinder-b19d96a3-60b0-40fa-9147-544091986aaa-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a3d29989-bdab-4320-a976-a74fd7a9a918 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-b19d96a3-60b0-40fa-9147-544091986aaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a3d29989-bdab-4320-a976-a74fd7a9a918 tempest-SnapshotsActionsTest-798556426 None] Acquiring lock "cinder-quobyte-c3c01dec-bf67-4ef0-88e4-d0a734714d59" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a3d29989-bdab-4320-a976-a74fd7a9a918 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-quobyte-c3c01dec-bf67-4ef0-88e4-d0a734714d59" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:23 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a3d29989-bdab-4320-a976-a74fd7a9a918 tempest-SnapshotsActionsTest-798556426 None] Acquiring lock "cinder-quobyte-b19d96a3-60b0-40fa-9147-544091986aaa" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a3d29989-bdab-4320-a976-a74fd7a9a918 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-quobyte-b19d96a3-60b0-40fa-9147-544091986aaa" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-a3d29989-bdab-4320-a976-a74fd7a9a918 tempest-SnapshotsActionsTest-798556426 None] Deleting offline snapshot b19d96a3-60b0-40fa-9147-544091986aaa of volume c3c01dec-bf67-4ef0-88e4-d0a734714d59 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-a3d29989-bdab-4320-a976-a74fd7a9a918 tempest-SnapshotsActionsTest-798556426 None] snapshot_file for this snap is: volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.b19d96a3-60b0-40fa-9147-544091986aaa {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e792c1-01db-44c7-a930-eeacfa5ef827]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3d29989-bdab-4320-a976-a74fd7a9a918 tempest-SnapshotsActionsTest-798556426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.b19d96a3-60b0-40fa-9147-544091986aaa {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:24 devstack sudo[88654]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8a7578e5-ed0a-4007-ba98-f4fded8a459d tempest-SnapshotDependencyTests-22341852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.87702c1f-ceeb-4691-aa80-0e99dc83581f" returned: 0 in 0.533s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8a7578e5-ed0a-4007-ba98-f4fded8a459d tempest-SnapshotDependencyTests-22341852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.87702c1f-ceeb-4691-aa80-0e99dc83581f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:24 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.87702c1f-ceeb-4691-aa80-0e99dc83581f Apr 15 20:11:24 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:24 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.b19d96a3-60b0-40fa-9147-544091986aaa Apr 15 20:11:24 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:24 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc" returned: 0 in 0.424s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cfff8a9-f5c9-4b73-adae-72042010a61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b57d31d-285c-4839-a1f9-e175e1370508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:24 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Volume volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc (310cde1c-2965-46ca-a8b2-60fc5c7c5ddc): created successfully Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b57d31d-285c-4839-a1f9-e175e1370508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Flow 'volume_create_manager' (738e76b3-7068-43c9-b589-b269fc5de492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:11:24 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-33cb2fbf-da77-4018-a4d0-c5ef1f48a896 tempest-VolumesActionsTest-1052978251 None] Created volume successfully. Apr 15 20:11:24 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8a7578e5-ed0a-4007-ba98-f4fded8a459d tempest-SnapshotDependencyTests-22341852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5.87702c1f-ceeb-4691-aa80-0e99dc83581f" returned: 0 in 0.415s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8a7578e5-ed0a-4007-ba98-f4fded8a459d tempest-SnapshotDependencyTests-22341852 None] Lock "cinder-quobyte-87702c1f-ceeb-4691-aa80-0e99dc83581f" released by "_delete_snapshot" :: held 1.910s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8a7578e5-ed0a-4007-ba98-f4fded8a459d tempest-SnapshotDependencyTests-22341852 None] Lock "cinder-quobyte-8b34f108-2fe9-44f5-8baa-af9302b9eae5" released by "delete_snapshot" :: held 1.920s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:24 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3d29989-bdab-4320-a976-a74fd7a9a918 tempest-SnapshotsActionsTest-798556426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.b19d96a3-60b0-40fa-9147-544091986aaa" returned: 0 in 0.468s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-a3d29989-bdab-4320-a976-a74fd7a9a918 tempest-SnapshotsActionsTest-798556426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[0764f8e5-5a29-4bef-83bb-3f2017c45b4a]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3d29989-bdab-4320-a976-a74fd7a9a918 tempest-SnapshotsActionsTest-798556426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-8a7578e5-ed0a-4007-ba98-f4fded8a459d tempest-SnapshotDependencyTests-22341852 None] Created reservations ['c4fc6707-8115-40c3-97be-5246945989e0', '950505f5-a650-4dda-aaef-2132d265f5d9', '29ad2d39-81eb-44e3-b449-20a0299d4855', 'd69ca412-56ef-42ca-bcfb-631bb542fcca'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:11:24 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-8a7578e5-ed0a-4007-ba98-f4fded8a459d tempest-SnapshotDependencyTests-22341852 None] Delete snapshot completed successfully. Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8a7578e5-ed0a-4007-ba98-f4fded8a459d tempest-SnapshotDependencyTests-22341852 None] Lock "cinder-87702c1f-ceeb-4691-aa80-0e99dc83581f-delete_snapshot" released by "delete_snapshot" :: held 2.021s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:24 devstack sudo[88673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 Apr 15 20:11:24 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-47a0ac99-5884-45bd-8e4b-60952feea688 tempest-SnapshotDependencyTests-22341852 None] Acquiring lock "cinder-8b34f108-2fe9-44f5-8baa-af9302b9eae5-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-47a0ac99-5884-45bd-8e4b-60952feea688 tempest-SnapshotDependencyTests-22341852 None] Lock "cinder-8b34f108-2fe9-44f5-8baa-af9302b9eae5-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-47a0ac99-5884-45bd-8e4b-60952feea688 tempest-SnapshotDependencyTests-22341852 None] Acquiring lock "cinder-quobyte-8b34f108-2fe9-44f5-8baa-af9302b9eae5" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-47a0ac99-5884-45bd-8e4b-60952feea688 tempest-SnapshotDependencyTests-22341852 None] Lock "cinder-quobyte-8b34f108-2fe9-44f5-8baa-af9302b9eae5" acquired by "delete_volume" :: waited 0.014s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[c252b8cb-70ad-451f-9c3e-022d762ee55e]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-47a0ac99-5884-45bd-8e4b-60952feea688 tempest-SnapshotDependencyTests-22341852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:24 devstack sudo[88675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 Apr 15 20:11:24 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:25 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3d29989-bdab-4320-a976-a74fd7a9a918 tempest-SnapshotsActionsTest-798556426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74" returned: 0 in 0.519s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:25 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-a3d29989-bdab-4320-a976-a74fd7a9a918 tempest-SnapshotsActionsTest-798556426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:11:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3d29989-bdab-4320-a976-a74fd7a9a918 tempest-SnapshotsActionsTest-798556426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.b19d96a3-60b0-40fa-9147-544091986aaa {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:25 devstack sudo[88680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.b19d96a3-60b0-40fa-9147-544091986aaa Apr 15 20:11:25 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:25 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-47a0ac99-5884-45bd-8e4b-60952feea688 tempest-SnapshotDependencyTests-22341852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5" returned: 0 in 0.496s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-47a0ac99-5884-45bd-8e4b-60952feea688 tempest-SnapshotDependencyTests-22341852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:25 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5 Apr 15 20:11:25 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:25 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3d29989-bdab-4320-a976-a74fd7a9a918 tempest-SnapshotsActionsTest-798556426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.b19d96a3-60b0-40fa-9147-544091986aaa" returned: 0 in 0.522s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3d29989-bdab-4320-a976-a74fd7a9a918 tempest-SnapshotsActionsTest-798556426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.b19d96a3-60b0-40fa-9147-544091986aaa {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:25 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.b19d96a3-60b0-40fa-9147-544091986aaa Apr 15 20:11:25 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:25 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-47a0ac99-5884-45bd-8e4b-60952feea688 tempest-SnapshotDependencyTests-22341852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8b34f108-2fe9-44f5-8baa-af9302b9eae5" returned: 0 in 0.440s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-47a0ac99-5884-45bd-8e4b-60952feea688 tempest-SnapshotDependencyTests-22341852 None] Lock "cinder-quobyte-8b34f108-2fe9-44f5-8baa-af9302b9eae5" released by "delete_volume" :: held 0.967s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:25 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-47a0ac99-5884-45bd-8e4b-60952feea688 tempest-SnapshotDependencyTests-22341852 None] Created reservations ['b1d8dc4f-2bfb-438d-a534-84eb1661e96e', '591b30b2-f0cb-4e74-a355-dca1b4406828', 'e240e75e-dc17-42ac-8e73-a1086e050b4c', '0635d294-30b5-4fd9-9d36-fb75178e0e9c'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:11:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-47a0ac99-5884-45bd-8e4b-60952feea688 tempest-SnapshotDependencyTests-22341852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-47a0ac99-5884-45bd-8e4b-60952feea688 tempest-SnapshotDependencyTests-22341852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:25 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-47a0ac99-5884-45bd-8e4b-60952feea688 tempest-SnapshotDependencyTests-22341852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:11:25 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-47a0ac99-5884-45bd-8e4b-60952feea688 tempest-SnapshotDependencyTests-22341852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:11:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-47a0ac99-5884-45bd-8e4b-60952feea688 tempest-SnapshotDependencyTests-22341852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-47a0ac99-5884-45bd-8e4b-60952feea688 tempest-SnapshotDependencyTests-22341852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:25 devstack sudo[88696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:11:25 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b3652351-cb2c-4c21-902b-bf9128244c7d tempest-SnapshotDependencyTests-22341852 None] Acquiring lock "cinder-7fc1d575-073f-4576-a5c5-9f6b59f1107c-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b3652351-cb2c-4c21-902b-bf9128244c7d tempest-SnapshotDependencyTests-22341852 None] Lock "cinder-7fc1d575-073f-4576-a5c5-9f6b59f1107c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b3652351-cb2c-4c21-902b-bf9128244c7d tempest-SnapshotDependencyTests-22341852 None] Acquiring lock "cinder-quobyte-7fc1d575-073f-4576-a5c5-9f6b59f1107c" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b3652351-cb2c-4c21-902b-bf9128244c7d tempest-SnapshotDependencyTests-22341852 None] Lock "cinder-quobyte-7fc1d575-073f-4576-a5c5-9f6b59f1107c" acquired by "delete_volume" :: waited 0.013s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:25 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a41160-b29a-4606-87cd-587f1442e780]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b3652351-cb2c-4c21-902b-bf9128244c7d tempest-SnapshotDependencyTests-22341852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7fc1d575-073f-4576-a5c5-9f6b59f1107c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:25 devstack sudo[88698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7fc1d575-073f-4576-a5c5-9f6b59f1107c Apr 15 20:11:25 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:26 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3d29989-bdab-4320-a976-a74fd7a9a918 tempest-SnapshotsActionsTest-798556426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.b19d96a3-60b0-40fa-9147-544091986aaa" returned: 0 in 0.466s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:26 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a3d29989-bdab-4320-a976-a74fd7a9a918 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-quobyte-b19d96a3-60b0-40fa-9147-544091986aaa" released by "_delete_snapshot" :: held 2.023s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:26 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a3d29989-bdab-4320-a976-a74fd7a9a918 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-quobyte-c3c01dec-bf67-4ef0-88e4-d0a734714d59" released by "delete_snapshot" :: held 2.034s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:26 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-a3d29989-bdab-4320-a976-a74fd7a9a918 tempest-SnapshotsActionsTest-798556426 None] Created reservations ['1684e6d0-7b9d-487f-8b05-53e4f2a06023', 'b18118bd-8b25-4f1e-a609-495c475f2828', '64456dbc-605b-4940-b610-df380e8ba71e', '8de4574c-eb2a-4d52-8da3-e589a246e5ae'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:11:26 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-a3d29989-bdab-4320-a976-a74fd7a9a918 tempest-SnapshotsActionsTest-798556426 None] Delete snapshot completed successfully. Apr 15 20:11:26 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a3d29989-bdab-4320-a976-a74fd7a9a918 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-b19d96a3-60b0-40fa-9147-544091986aaa-delete_snapshot" released by "delete_snapshot" :: held 2.124s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:26 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-47a0ac99-5884-45bd-8e4b-60952feea688 tempest-SnapshotDependencyTests-22341852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.503s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:26 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-47a0ac99-5884-45bd-8e4b-60952feea688 tempest-SnapshotDependencyTests-22341852 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:11:26 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-47a0ac99-5884-45bd-8e4b-60952feea688 tempest-SnapshotDependencyTests-22341852 None] Deleted volume successfully. Apr 15 20:11:26 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-47a0ac99-5884-45bd-8e4b-60952feea688 tempest-SnapshotDependencyTests-22341852 None] Lock "cinder-8b34f108-2fe9-44f5-8baa-af9302b9eae5-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:26 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b3652351-cb2c-4c21-902b-bf9128244c7d tempest-SnapshotDependencyTests-22341852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7fc1d575-073f-4576-a5c5-9f6b59f1107c" returned: 0 in 0.492s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b3652351-cb2c-4c21-902b-bf9128244c7d tempest-SnapshotDependencyTests-22341852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7fc1d575-073f-4576-a5c5-9f6b59f1107c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:26 devstack sudo[88706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7fc1d575-073f-4576-a5c5-9f6b59f1107c Apr 15 20:11:26 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:26 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b3652351-cb2c-4c21-902b-bf9128244c7d tempest-SnapshotDependencyTests-22341852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7fc1d575-073f-4576-a5c5-9f6b59f1107c" returned: 0 in 0.439s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:26 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b3652351-cb2c-4c21-902b-bf9128244c7d tempest-SnapshotDependencyTests-22341852 None] Lock "cinder-quobyte-7fc1d575-073f-4576-a5c5-9f6b59f1107c" released by "delete_volume" :: held 0.954s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:26 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-b3652351-cb2c-4c21-902b-bf9128244c7d tempest-SnapshotDependencyTests-22341852 None] Created reservations ['2f935701-c2e2-4db5-93f6-4d4e9238e672', 'e7c0eefa-a7dc-431f-96ec-5adf94ecfdb7', '061a7a64-b641-47a7-8487-aa7b115bf12a', 'c49c9ccf-9c8c-424c-9359-2d9837e5fd70'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:11:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b3652351-cb2c-4c21-902b-bf9128244c7d tempest-SnapshotDependencyTests-22341852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b3652351-cb2c-4c21-902b-bf9128244c7d tempest-SnapshotDependencyTests-22341852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:26 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b3652351-cb2c-4c21-902b-bf9128244c7d tempest-SnapshotDependencyTests-22341852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:11:26 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b3652351-cb2c-4c21-902b-bf9128244c7d tempest-SnapshotDependencyTests-22341852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:11:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b3652351-cb2c-4c21-902b-bf9128244c7d tempest-SnapshotDependencyTests-22341852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b3652351-cb2c-4c21-902b-bf9128244c7d tempest-SnapshotDependencyTests-22341852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:26 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:11:26 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:27 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b3652351-cb2c-4c21-902b-bf9128244c7d tempest-SnapshotDependencyTests-22341852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.420s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:27 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-b3652351-cb2c-4c21-902b-bf9128244c7d tempest-SnapshotDependencyTests-22341852 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:11:27 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-b3652351-cb2c-4c21-902b-bf9128244c7d tempest-SnapshotDependencyTests-22341852 None] Deleted volume successfully. Apr 15 20:11:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b3652351-cb2c-4c21-902b-bf9128244c7d tempest-SnapshotDependencyTests-22341852 None] Lock "cinder-7fc1d575-073f-4576-a5c5-9f6b59f1107c-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-4ad8b87b-ac32-45df-aa78-2ac01fd9e63d tempest-SnapshotsActionsTest-642137088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-4ad8b87b-ac32-45df-aa78-2ac01fd9e63d tempest-SnapshotsActionsTest-642137088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-4ad8b87b-ac32-45df-aa78-2ac01fd9e63d tempest-SnapshotsActionsTest-642137088 None] Creating offline snapshot 3ad0001b-aa9f-4073-81c1-1d3497b99b55 of volume c3c01dec-bf67-4ef0-88e4-d0a734714d59 {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:11:27 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[265123bb-1967-4d35-89ac-37ad758b2b10]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-4ad8b87b-ac32-45df-aa78-2ac01fd9e63d tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:27 devstack sudo[88712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 Apr 15 20:11:27 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:27 devstack cinder-volume[82989]: DEBUG oslo_service.periodic_task [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82989) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 20:11:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:11:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:11:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:27 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:11:27 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:27 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-4ad8b87b-ac32-45df-aa78-2ac01fd9e63d tempest-SnapshotsActionsTest-642137088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74" returned: 0 in 0.562s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-4ad8b87b-ac32-45df-aa78-2ac01fd9e63d tempest-SnapshotsActionsTest-642137088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:11:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-4ad8b87b-ac32-45df-aa78-2ac01fd9e63d tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3ad0001b-aa9f-4073-81c1-1d3497b99b55 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:27 devstack sudo[88719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3ad0001b-aa9f-4073-81c1-1d3497b99b55 1G Apr 15 20:11:27 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:28 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.467s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:28 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:11:28 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-4ad8b87b-ac32-45df-aa78-2ac01fd9e63d tempest-SnapshotsActionsTest-642137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3ad0001b-aa9f-4073-81c1-1d3497b99b55 1G" returned: 0 in 0.548s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-4ad8b87b-ac32-45df-aa78-2ac01fd9e63d tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3ad0001b-aa9f-4073-81c1-1d3497b99b55 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:28 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3ad0001b-aa9f-4073-81c1-1d3497b99b55 Apr 15 20:11:28 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:28 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-4ad8b87b-ac32-45df-aa78-2ac01fd9e63d tempest-SnapshotsActionsTest-642137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3ad0001b-aa9f-4073-81c1-1d3497b99b55" returned: 0 in 0.428s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:28 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-4ad8b87b-ac32-45df-aa78-2ac01fd9e63d tempest-SnapshotsActionsTest-642137088 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3ad0001b-aa9f-4073-81c1-1d3497b99b55 is being set with open permissions: ugo+rw Apr 15 20:11:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-4ad8b87b-ac32-45df-aa78-2ac01fd9e63d tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3ad0001b-aa9f-4073-81c1-1d3497b99b55 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:28 devstack sudo[88731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3ad0001b-aa9f-4073-81c1-1d3497b99b55 Apr 15 20:11:28 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:29 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-4ad8b87b-ac32-45df-aa78-2ac01fd9e63d tempest-SnapshotsActionsTest-642137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3ad0001b-aa9f-4073-81c1-1d3497b99b55" returned: 0 in 0.459s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-4ad8b87b-ac32-45df-aa78-2ac01fd9e63d tempest-SnapshotsActionsTest-642137088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.050s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:29 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-4ad8b87b-ac32-45df-aa78-2ac01fd9e63d tempest-SnapshotsActionsTest-642137088 None] Create snapshot completed successfully Apr 15 20:11:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7e39c5d6-563d-4720-b509-519d793b9354 tempest-SnapshotsActionsTest-798556426 None] Acquiring lock "cinder-3ad0001b-aa9f-4073-81c1-1d3497b99b55-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7e39c5d6-563d-4720-b509-519d793b9354 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-3ad0001b-aa9f-4073-81c1-1d3497b99b55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7e39c5d6-563d-4720-b509-519d793b9354 tempest-SnapshotsActionsTest-798556426 None] Acquiring lock "cinder-quobyte-c3c01dec-bf67-4ef0-88e4-d0a734714d59" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7e39c5d6-563d-4720-b509-519d793b9354 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-quobyte-c3c01dec-bf67-4ef0-88e4-d0a734714d59" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7e39c5d6-563d-4720-b509-519d793b9354 tempest-SnapshotsActionsTest-798556426 None] Acquiring lock "cinder-quobyte-3ad0001b-aa9f-4073-81c1-1d3497b99b55" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7e39c5d6-563d-4720-b509-519d793b9354 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-quobyte-3ad0001b-aa9f-4073-81c1-1d3497b99b55" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-7e39c5d6-563d-4720-b509-519d793b9354 tempest-SnapshotsActionsTest-798556426 None] Deleting offline snapshot 3ad0001b-aa9f-4073-81c1-1d3497b99b55 of volume c3c01dec-bf67-4ef0-88e4-d0a734714d59 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:11:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-7e39c5d6-563d-4720-b509-519d793b9354 tempest-SnapshotsActionsTest-798556426 None] snapshot_file for this snap is: volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3ad0001b-aa9f-4073-81c1-1d3497b99b55 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:11:30 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[86754b3c-0117-44f4-86f9-26d9d938a665]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7e39c5d6-563d-4720-b509-519d793b9354 tempest-SnapshotsActionsTest-798556426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3ad0001b-aa9f-4073-81c1-1d3497b99b55 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:30 devstack sudo[88735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3ad0001b-aa9f-4073-81c1-1d3497b99b55 Apr 15 20:11:30 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:31 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7e39c5d6-563d-4720-b509-519d793b9354 tempest-SnapshotsActionsTest-798556426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3ad0001b-aa9f-4073-81c1-1d3497b99b55" returned: 0 in 0.597s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:31 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-7e39c5d6-563d-4720-b509-519d793b9354 tempest-SnapshotsActionsTest-798556426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:11:31 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2299fa7-94e2-4ea6-a447-86495d645d6b]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7e39c5d6-563d-4720-b509-519d793b9354 tempest-SnapshotsActionsTest-798556426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:31 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 Apr 15 20:11:31 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:31 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7e39c5d6-563d-4720-b509-519d793b9354 tempest-SnapshotsActionsTest-798556426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74" returned: 0 in 0.668s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:31 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-7e39c5d6-563d-4720-b509-519d793b9354 tempest-SnapshotsActionsTest-798556426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:11:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7e39c5d6-563d-4720-b509-519d793b9354 tempest-SnapshotsActionsTest-798556426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3ad0001b-aa9f-4073-81c1-1d3497b99b55 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:31 devstack sudo[88752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3ad0001b-aa9f-4073-81c1-1d3497b99b55 Apr 15 20:11:31 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:32 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7e39c5d6-563d-4720-b509-519d793b9354 tempest-SnapshotsActionsTest-798556426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3ad0001b-aa9f-4073-81c1-1d3497b99b55" returned: 0 in 0.621s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7e39c5d6-563d-4720-b509-519d793b9354 tempest-SnapshotsActionsTest-798556426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3ad0001b-aa9f-4073-81c1-1d3497b99b55 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:32 devstack sudo[88769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3ad0001b-aa9f-4073-81c1-1d3497b99b55 Apr 15 20:11:32 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:33 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7e39c5d6-563d-4720-b509-519d793b9354 tempest-SnapshotsActionsTest-798556426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3ad0001b-aa9f-4073-81c1-1d3497b99b55" returned: 0 in 0.527s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7e39c5d6-563d-4720-b509-519d793b9354 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-quobyte-3ad0001b-aa9f-4073-81c1-1d3497b99b55" released by "_delete_snapshot" :: held 2.472s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7e39c5d6-563d-4720-b509-519d793b9354 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-quobyte-c3c01dec-bf67-4ef0-88e4-d0a734714d59" released by "delete_snapshot" :: held 2.486s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:33 devstack cinder-volume[82989]: DEBUG dbcounter [-] [82989] Writing DB stats cinder:UPDATE=212,cinder:DELETE=18,cinder:SELECT=193,cinder:INSERT=49 {{(pid=82989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:11:33 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-7e39c5d6-563d-4720-b509-519d793b9354 tempest-SnapshotsActionsTest-798556426 None] Created reservations ['6d21fe5c-f5e3-429c-a017-e8deb218fa2a', 'b47c9cd9-2d46-405a-b202-12fe820eb347', '6e7de925-7edb-4db7-900a-0a590a43528a', '409ed8e5-0754-4670-a247-3070fa16f482'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:11:33 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-7e39c5d6-563d-4720-b509-519d793b9354 tempest-SnapshotsActionsTest-798556426 None] Delete snapshot completed successfully. Apr 15 20:11:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7e39c5d6-563d-4720-b509-519d793b9354 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-3ad0001b-aa9f-4073-81c1-1d3497b99b55-delete_snapshot" released by "delete_snapshot" :: held 2.576s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b9ba68e8-d997-4c14-b032-dc0a1c412ae1 tempest-SnapshotsActionsTest-642137088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b9ba68e8-d997-4c14-b032-dc0a1c412ae1 tempest-SnapshotsActionsTest-642137088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:33 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-b9ba68e8-d997-4c14-b032-dc0a1c412ae1 tempest-SnapshotsActionsTest-642137088 None] Creating offline snapshot 3c2cebae-f130-428c-915d-b628d2b0e06d of volume c3c01dec-bf67-4ef0-88e4-d0a734714d59 {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:11:33 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[e338a296-3939-4db4-bb04-c745888c1642]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b9ba68e8-d997-4c14-b032-dc0a1c412ae1 tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:34 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 Apr 15 20:11:34 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:34 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b9ba68e8-d997-4c14-b032-dc0a1c412ae1 tempest-SnapshotsActionsTest-642137088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74" returned: 0 in 0.466s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-b9ba68e8-d997-4c14-b032-dc0a1c412ae1 tempest-SnapshotsActionsTest-642137088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:11:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b9ba68e8-d997-4c14-b032-dc0a1c412ae1 tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3c2cebae-f130-428c-915d-b628d2b0e06d 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:34 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3c2cebae-f130-428c-915d-b628d2b0e06d 1G Apr 15 20:11:34 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:34 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b9ba68e8-d997-4c14-b032-dc0a1c412ae1 tempest-SnapshotsActionsTest-642137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3c2cebae-f130-428c-915d-b628d2b0e06d 1G" returned: 0 in 0.506s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b9ba68e8-d997-4c14-b032-dc0a1c412ae1 tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3c2cebae-f130-428c-915d-b628d2b0e06d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:34 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3c2cebae-f130-428c-915d-b628d2b0e06d Apr 15 20:11:34 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:35 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b9ba68e8-d997-4c14-b032-dc0a1c412ae1 tempest-SnapshotsActionsTest-642137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3c2cebae-f130-428c-915d-b628d2b0e06d" returned: 0 in 0.408s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:35 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-b9ba68e8-d997-4c14-b032-dc0a1c412ae1 tempest-SnapshotsActionsTest-642137088 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3c2cebae-f130-428c-915d-b628d2b0e06d is being set with open permissions: ugo+rw Apr 15 20:11:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b9ba68e8-d997-4c14-b032-dc0a1c412ae1 tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3c2cebae-f130-428c-915d-b628d2b0e06d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:35 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3c2cebae-f130-428c-915d-b628d2b0e06d Apr 15 20:11:35 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:35 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b9ba68e8-d997-4c14-b032-dc0a1c412ae1 tempest-SnapshotsActionsTest-642137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3c2cebae-f130-428c-915d-b628d2b0e06d" returned: 0 in 0.394s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b9ba68e8-d997-4c14-b032-dc0a1c412ae1 tempest-SnapshotsActionsTest-642137088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.836s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:35 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-b9ba68e8-d997-4c14-b032-dc0a1c412ae1 tempest-SnapshotsActionsTest-642137088 None] Create snapshot completed successfully Apr 15 20:11:36 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a65309dc-a1eb-4752-90e3-897b20687fc7 tempest-SnapshotsActionsTest-798556426 None] Acquiring lock "cinder-3c2cebae-f130-428c-915d-b628d2b0e06d-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:36 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a65309dc-a1eb-4752-90e3-897b20687fc7 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-3c2cebae-f130-428c-915d-b628d2b0e06d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:36 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a65309dc-a1eb-4752-90e3-897b20687fc7 tempest-SnapshotsActionsTest-798556426 None] Acquiring lock "cinder-quobyte-c3c01dec-bf67-4ef0-88e4-d0a734714d59" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:36 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a65309dc-a1eb-4752-90e3-897b20687fc7 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-quobyte-c3c01dec-bf67-4ef0-88e4-d0a734714d59" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:36 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a65309dc-a1eb-4752-90e3-897b20687fc7 tempest-SnapshotsActionsTest-798556426 None] Acquiring lock "cinder-quobyte-3c2cebae-f130-428c-915d-b628d2b0e06d" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:36 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a65309dc-a1eb-4752-90e3-897b20687fc7 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-quobyte-3c2cebae-f130-428c-915d-b628d2b0e06d" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:36 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-a65309dc-a1eb-4752-90e3-897b20687fc7 tempest-SnapshotsActionsTest-798556426 None] Deleting offline snapshot 3c2cebae-f130-428c-915d-b628d2b0e06d of volume c3c01dec-bf67-4ef0-88e4-d0a734714d59 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:11:36 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-a65309dc-a1eb-4752-90e3-897b20687fc7 tempest-SnapshotsActionsTest-798556426 None] snapshot_file for this snap is: volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3c2cebae-f130-428c-915d-b628d2b0e06d {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:11:36 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a15a2ef-db6d-4da7-8e74-a528158c111c]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a65309dc-a1eb-4752-90e3-897b20687fc7 tempest-SnapshotsActionsTest-798556426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3c2cebae-f130-428c-915d-b628d2b0e06d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:36 devstack sudo[88794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3c2cebae-f130-428c-915d-b628d2b0e06d Apr 15 20:11:36 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:36 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a65309dc-a1eb-4752-90e3-897b20687fc7 tempest-SnapshotsActionsTest-798556426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3c2cebae-f130-428c-915d-b628d2b0e06d" returned: 0 in 0.586s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:36 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-a65309dc-a1eb-4752-90e3-897b20687fc7 tempest-SnapshotsActionsTest-798556426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:11:36 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[450bc45b-f7be-481f-aff0-dfe778efa58f]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a65309dc-a1eb-4752-90e3-897b20687fc7 tempest-SnapshotsActionsTest-798556426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:36 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 Apr 15 20:11:36 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:37 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a65309dc-a1eb-4752-90e3-897b20687fc7 tempest-SnapshotsActionsTest-798556426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74" returned: 0 in 0.523s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:37 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-a65309dc-a1eb-4752-90e3-897b20687fc7 tempest-SnapshotsActionsTest-798556426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:11:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a65309dc-a1eb-4752-90e3-897b20687fc7 tempest-SnapshotsActionsTest-798556426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3c2cebae-f130-428c-915d-b628d2b0e06d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:37 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3c2cebae-f130-428c-915d-b628d2b0e06d Apr 15 20:11:37 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:37 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a65309dc-a1eb-4752-90e3-897b20687fc7 tempest-SnapshotsActionsTest-798556426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3c2cebae-f130-428c-915d-b628d2b0e06d" returned: 0 in 0.451s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a65309dc-a1eb-4752-90e3-897b20687fc7 tempest-SnapshotsActionsTest-798556426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3c2cebae-f130-428c-915d-b628d2b0e06d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:37 devstack sudo[88837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3c2cebae-f130-428c-915d-b628d2b0e06d Apr 15 20:11:37 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:38 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a65309dc-a1eb-4752-90e3-897b20687fc7 tempest-SnapshotsActionsTest-798556426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.3c2cebae-f130-428c-915d-b628d2b0e06d" returned: 0 in 0.416s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:38 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a65309dc-a1eb-4752-90e3-897b20687fc7 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-quobyte-3c2cebae-f130-428c-915d-b628d2b0e06d" released by "_delete_snapshot" :: held 2.031s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:38 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a65309dc-a1eb-4752-90e3-897b20687fc7 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-quobyte-c3c01dec-bf67-4ef0-88e4-d0a734714d59" released by "delete_snapshot" :: held 2.043s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:38 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-a65309dc-a1eb-4752-90e3-897b20687fc7 tempest-SnapshotsActionsTest-798556426 None] Created reservations ['face86d6-493a-478b-a482-0406e5847a27', 'c0fa4975-16c9-47d3-b381-2645b1f4cc98', '11eea354-bf37-4a0b-bb13-c4cf3a74714f', '75ae7c9e-c817-4dff-af5b-1243b8ca3a2a'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:11:38 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-a65309dc-a1eb-4752-90e3-897b20687fc7 tempest-SnapshotsActionsTest-798556426 None] Delete snapshot completed successfully. Apr 15 20:11:38 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a65309dc-a1eb-4752-90e3-897b20687fc7 tempest-SnapshotsActionsTest-798556426 None] Lock "cinder-3c2cebae-f130-428c-915d-b628d2b0e06d-delete_snapshot" released by "delete_snapshot" :: held 2.156s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:38 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1509aad3-e96a-4242-915e-54aff156d07c tempest-VolumesActionsTest-1052978251 None] Acquiring lock "cinder-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc" by "attach_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:38 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1509aad3-e96a-4242-915e-54aff156d07c tempest-VolumesActionsTest-1052978251 None] Lock "cinder-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc" acquired by "attach_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:38 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-1509aad3-e96a-4242-915e-54aff156d07c tempest-VolumesActionsTest-1052978251 None] Attaching volume 310cde1c-2965-46ca-a8b2-60fc5c7c5ddc to instance f4e0d6ce-9b8e-4c35-a9ec-9fa34d5048ee at mountpoint /dev/vdb on host None. Apr 15 20:11:38 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-1509aad3-e96a-4242-915e-54aff156d07c tempest-VolumesActionsTest-1052978251 None] Attach volume completed successfully. Apr 15 20:11:38 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1509aad3-e96a-4242-915e-54aff156d07c tempest-VolumesActionsTest-1052978251 None] Lock "cinder-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc" released by "attach_volume" :: held 0.055s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:38 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-920b4cf6-131d-41e2-a042-80970b3cdab4 tempest-VolumesActionsTest-1052978251 None] Acquiring lock "cinder-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc-detach_volume" by "detach_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:38 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-920b4cf6-131d-41e2-a042-80970b3cdab4 tempest-VolumesActionsTest-1052978251 None] Lock "cinder-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc-detach_volume" acquired by "detach_volume" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:38 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-920b4cf6-131d-41e2-a042-80970b3cdab4 tempest-VolumesActionsTest-1052978251 None] Detaching volume 310cde1c-2965-46ca-a8b2-60fc5c7c5ddc from instance f4e0d6ce-9b8e-4c35-a9ec-9fa34d5048ee. Apr 15 20:11:38 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-920b4cf6-131d-41e2-a042-80970b3cdab4 tempest-VolumesActionsTest-1052978251 None] Detach volume completed successfully. Apr 15 20:11:38 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-920b4cf6-131d-41e2-a042-80970b3cdab4 tempest-VolumesActionsTest-1052978251 None] Lock "cinder-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a6fae094-9c31-44af-814a-f7b9c08e9d8c tempest-SnapshotsActionsTest-642137088 None] Acquiring lock "cinder-92164d9d-00c5-4941-bf21-0a0960f2ae74-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a6fae094-9c31-44af-814a-f7b9c08e9d8c tempest-SnapshotsActionsTest-642137088 None] Lock "cinder-92164d9d-00c5-4941-bf21-0a0960f2ae74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a6fae094-9c31-44af-814a-f7b9c08e9d8c tempest-SnapshotsActionsTest-642137088 None] Acquiring lock "cinder-quobyte-c3c01dec-bf67-4ef0-88e4-d0a734714d59" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a6fae094-9c31-44af-814a-f7b9c08e9d8c tempest-SnapshotsActionsTest-642137088 None] Lock "cinder-quobyte-c3c01dec-bf67-4ef0-88e4-d0a734714d59" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a6fae094-9c31-44af-814a-f7b9c08e9d8c tempest-SnapshotsActionsTest-642137088 None] Acquiring lock "cinder-quobyte-92164d9d-00c5-4941-bf21-0a0960f2ae74" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a6fae094-9c31-44af-814a-f7b9c08e9d8c tempest-SnapshotsActionsTest-642137088 None] Lock "cinder-quobyte-92164d9d-00c5-4941-bf21-0a0960f2ae74" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:39 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-a6fae094-9c31-44af-814a-f7b9c08e9d8c tempest-SnapshotsActionsTest-642137088 None] Deleting offline snapshot 92164d9d-00c5-4941-bf21-0a0960f2ae74 of volume c3c01dec-bf67-4ef0-88e4-d0a734714d59 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:11:39 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-a6fae094-9c31-44af-814a-f7b9c08e9d8c tempest-SnapshotsActionsTest-642137088 None] snapshot_file for this snap is: volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:11:39 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ac1df4-fc2c-41a8-875f-92d44a0b0de4]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a6fae094-9c31-44af-814a-f7b9c08e9d8c tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:39 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 Apr 15 20:11:39 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:40 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a6fae094-9c31-44af-814a-f7b9c08e9d8c tempest-SnapshotsActionsTest-642137088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74" returned: 0 in 0.495s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-a6fae094-9c31-44af-814a-f7b9c08e9d8c tempest-SnapshotsActionsTest-642137088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:11:40 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[509e89ae-1f8e-4781-8320-8945ec9c59c4]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a6fae094-9c31-44af-814a-f7b9c08e9d8c tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:40 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59 Apr 15 20:11:40 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:40 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a6fae094-9c31-44af-814a-f7b9c08e9d8c tempest-SnapshotsActionsTest-642137088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59" returned: 0 in 0.514s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a6fae094-9c31-44af-814a-f7b9c08e9d8c tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:40 devstack sudo[88859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 Apr 15 20:11:40 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:41 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a6fae094-9c31-44af-814a-f7b9c08e9d8c tempest-SnapshotsActionsTest-642137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74" returned: 0 in 0.521s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a6fae094-9c31-44af-814a-f7b9c08e9d8c tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:41 devstack sudo[88882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74 Apr 15 20:11:41 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:41 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a6fae094-9c31-44af-814a-f7b9c08e9d8c tempest-SnapshotsActionsTest-642137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59.92164d9d-00c5-4941-bf21-0a0960f2ae74" returned: 0 in 0.408s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:41 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a6fae094-9c31-44af-814a-f7b9c08e9d8c tempest-SnapshotsActionsTest-642137088 None] Lock "cinder-quobyte-92164d9d-00c5-4941-bf21-0a0960f2ae74" released by "_delete_snapshot" :: held 2.009s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:41 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a6fae094-9c31-44af-814a-f7b9c08e9d8c tempest-SnapshotsActionsTest-642137088 None] Lock "cinder-quobyte-c3c01dec-bf67-4ef0-88e4-d0a734714d59" released by "delete_snapshot" :: held 2.035s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:41 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-a6fae094-9c31-44af-814a-f7b9c08e9d8c tempest-SnapshotsActionsTest-642137088 None] Created reservations ['d9a60cf0-1454-4302-b347-c79089bec707', 'd7481a81-5ee5-411f-9381-78567f2b07d9', 'd5500f62-1968-4b67-af62-feeb4e17e0a1', '38137bb9-7433-41e7-a322-39442b53cf1f'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:11:41 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-a6fae094-9c31-44af-814a-f7b9c08e9d8c tempest-SnapshotsActionsTest-642137088 None] Delete snapshot completed successfully. Apr 15 20:11:41 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a6fae094-9c31-44af-814a-f7b9c08e9d8c tempest-SnapshotsActionsTest-642137088 None] Lock "cinder-92164d9d-00c5-4941-bf21-0a0960f2ae74-delete_snapshot" released by "delete_snapshot" :: held 2.130s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:42 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1e3d4dc8-b586-402f-9888-b7359d52868e tempest-SnapshotsActionsTest-642137088 None] Acquiring lock "cinder-c3c01dec-bf67-4ef0-88e4-d0a734714d59-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:42 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1e3d4dc8-b586-402f-9888-b7359d52868e tempest-SnapshotsActionsTest-642137088 None] Lock "cinder-c3c01dec-bf67-4ef0-88e4-d0a734714d59-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:42 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1e3d4dc8-b586-402f-9888-b7359d52868e tempest-SnapshotsActionsTest-642137088 None] Acquiring lock "cinder-quobyte-c3c01dec-bf67-4ef0-88e4-d0a734714d59" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:42 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1e3d4dc8-b586-402f-9888-b7359d52868e tempest-SnapshotsActionsTest-642137088 None] Lock "cinder-quobyte-c3c01dec-bf67-4ef0-88e4-d0a734714d59" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:42 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b187e58-04af-4b53-9e98-a7bf04dd7405]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1e3d4dc8-b586-402f-9888-b7359d52868e tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:42 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59 Apr 15 20:11:42 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:43 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1e3d4dc8-b586-402f-9888-b7359d52868e tempest-SnapshotsActionsTest-642137088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59" returned: 0 in 0.461s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1e3d4dc8-b586-402f-9888-b7359d52868e tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:43 devstack sudo[88893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59 Apr 15 20:11:43 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:43 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1e3d4dc8-b586-402f-9888-b7359d52868e tempest-SnapshotsActionsTest-642137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c3c01dec-bf67-4ef0-88e4-d0a734714d59" returned: 0 in 0.426s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:43 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1e3d4dc8-b586-402f-9888-b7359d52868e tempest-SnapshotsActionsTest-642137088 None] Lock "cinder-quobyte-c3c01dec-bf67-4ef0-88e4-d0a734714d59" released by "delete_volume" :: held 0.923s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:43 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-1e3d4dc8-b586-402f-9888-b7359d52868e tempest-SnapshotsActionsTest-642137088 None] Created reservations ['4b988c13-a0f3-49bd-b08e-fa06f21c4b05', '4565bd55-0b70-4890-b59b-fa6f7b2ddd97', '77ed4f93-6f09-454a-9c0c-3babf52dbdb4', '570af187-3ba6-4049-a4b9-36b0031da467'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:11:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1e3d4dc8-b586-402f-9888-b7359d52868e tempest-SnapshotsActionsTest-642137088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1e3d4dc8-b586-402f-9888-b7359d52868e tempest-SnapshotsActionsTest-642137088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1e3d4dc8-b586-402f-9888-b7359d52868e tempest-SnapshotsActionsTest-642137088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:11:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1e3d4dc8-b586-402f-9888-b7359d52868e tempest-SnapshotsActionsTest-642137088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:11:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1e3d4dc8-b586-402f-9888-b7359d52868e tempest-SnapshotsActionsTest-642137088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1e3d4dc8-b586-402f-9888-b7359d52868e tempest-SnapshotsActionsTest-642137088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:43 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:11:43 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:44 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1e3d4dc8-b586-402f-9888-b7359d52868e tempest-SnapshotsActionsTest-642137088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.444s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:44 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-1e3d4dc8-b586-402f-9888-b7359d52868e tempest-SnapshotsActionsTest-642137088 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:11:44 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-1e3d4dc8-b586-402f-9888-b7359d52868e tempest-SnapshotsActionsTest-642137088 None] Deleted volume successfully. Apr 15 20:11:44 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1e3d4dc8-b586-402f-9888-b7359d52868e tempest-SnapshotsActionsTest-642137088 None] Lock "cinder-c3c01dec-bf67-4ef0-88e4-d0a734714d59-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Flow 'volume_create_manager' (60fbaf4c-d220-418b-b84b-cb727f3c9aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac621ae-c07c-4dc5-a0a1-38cd8d664c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac621ae-c07c-4dc5-a0a1-38cd8d664c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1016086784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2d921fc-d38c-4b93-b0bf-506d0a08c432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ff6e047a30473a807e76ea3f446245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:47Z,use_quota=True,user_id='7e08f03952d6428abaef243b7a678351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ebbe43-a6b8-41dc-aa10-bebf0f2ccb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ebbe43-a6b8-41dc-aa10-bebf0f2ccb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4414f89-3cb5-42c7-a564-bd20ae59ef17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4414f89-3cb5-42c7-a564-bd20ae59ef17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2d921fc-d38c-4b93-b0bf-506d0a08c432', 'volume_name': 'volume-f2d921fc-d38c-4b93-b0bf-506d0a08c432', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6933a521-8bb8-496e-9290-2a293dd53a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6933a521-8bb8-496e-9290-2a293dd53a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7df15d-374e-49b4-abee-d8cafc19f4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:47 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Volume f2d921fc-d38c-4b93-b0bf-506d0a08c432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2d921fc-d38c-4b93-b0bf-506d0a08c432', 'volume_size': 1} Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1016086784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2d921fc-d38c-4b93-b0bf-506d0a08c432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ff6e047a30473a807e76ea3f446245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:47Z,use_quota=True,user_id='7e08f03952d6428abaef243b7a678351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Creating volume f2d921fc-d38c-4b93-b0bf-506d0a08c432 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:11:47 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2d921fc-d38c-4b93-b0bf-506d0a08c432 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:47 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2d921fc-d38c-4b93-b0bf-506d0a08c432 1073741824 Apr 15 20:11:47 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:47 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2d921fc-d38c-4b93-b0bf-506d0a08c432 1073741824" returned: 0 in 0.501s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2d921fc-d38c-4b93-b0bf-506d0a08c432 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:47 devstack sudo[88909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2d921fc-d38c-4b93-b0bf-506d0a08c432 Apr 15 20:11:47 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:48 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2d921fc-d38c-4b93-b0bf-506d0a08c432" returned: 0 in 0.407s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:11:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7df15d-374e-49b4-abee-d8cafc19f4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2d921fc-d38c-4b93-b0bf-506d0a08c432', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb6a191c-2c39-4e3e-ad6c-18e08e206989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:48 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Volume volume-f2d921fc-d38c-4b93-b0bf-506d0a08c432 (f2d921fc-d38c-4b93-b0bf-506d0a08c432): created successfully Apr 15 20:11:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb6a191c-2c39-4e3e-ad6c-18e08e206989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Flow 'volume_create_manager' (60fbaf4c-d220-418b-b84b-cb727f3c9aa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:11:48 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-2ca6d1fe-4c7d-448a-8d71-adbfd17c32a8 tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Created volume successfully. Apr 15 20:11:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7a3969a7-2cf9-4706-aac9-4686eba0dd0d tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Acquiring lock "cinder-f2d921fc-d38c-4b93-b0bf-506d0a08c432-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7a3969a7-2cf9-4706-aac9-4686eba0dd0d tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Lock "cinder-f2d921fc-d38c-4b93-b0bf-506d0a08c432-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7a3969a7-2cf9-4706-aac9-4686eba0dd0d tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Acquiring lock "cinder-quobyte-f2d921fc-d38c-4b93-b0bf-506d0a08c432" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7a3969a7-2cf9-4706-aac9-4686eba0dd0d tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Lock "cinder-quobyte-f2d921fc-d38c-4b93-b0bf-506d0a08c432" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:49 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70df4cc-c826-4ec4-996d-5deb611d5425]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7a3969a7-2cf9-4706-aac9-4686eba0dd0d tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2d921fc-d38c-4b93-b0bf-506d0a08c432 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:50 devstack sudo[88912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2d921fc-d38c-4b93-b0bf-506d0a08c432 Apr 15 20:11:50 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:50 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7a3969a7-2cf9-4706-aac9-4686eba0dd0d tempest-VolumeQuotasNegativeTestJSON-1332199492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2d921fc-d38c-4b93-b0bf-506d0a08c432" returned: 0 in 0.465s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7a3969a7-2cf9-4706-aac9-4686eba0dd0d tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2d921fc-d38c-4b93-b0bf-506d0a08c432 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:50 devstack sudo[88917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2d921fc-d38c-4b93-b0bf-506d0a08c432 Apr 15 20:11:50 devstack sudo[88917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:50 devstack sudo[88917]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7a3969a7-2cf9-4706-aac9-4686eba0dd0d tempest-VolumeQuotasNegativeTestJSON-1332199492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f2d921fc-d38c-4b93-b0bf-506d0a08c432" returned: 0 in 0.440s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:50 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7a3969a7-2cf9-4706-aac9-4686eba0dd0d tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Lock "cinder-quobyte-f2d921fc-d38c-4b93-b0bf-506d0a08c432" released by "delete_volume" :: held 0.932s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:50 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-7a3969a7-2cf9-4706-aac9-4686eba0dd0d tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Created reservations ['aabc375a-67ce-45dd-9ace-5f47cd6a71be', 'f6c1320b-291d-45c8-b98d-1e2c39ee238d', '899d378a-e1f9-482f-b996-65c116b1c900', 'c4f91f4c-3035-4bbf-9166-82f993841f80'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:11:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7a3969a7-2cf9-4706-aac9-4686eba0dd0d tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7a3969a7-2cf9-4706-aac9-4686eba0dd0d tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:50 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7a3969a7-2cf9-4706-aac9-4686eba0dd0d tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:11:50 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7a3969a7-2cf9-4706-aac9-4686eba0dd0d tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:11:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7a3969a7-2cf9-4706-aac9-4686eba0dd0d tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7a3969a7-2cf9-4706-aac9-4686eba0dd0d tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:50 devstack sudo[88920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:11:50 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:51 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7a3969a7-2cf9-4706-aac9-4686eba0dd0d tempest-VolumeQuotasNegativeTestJSON-1332199492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.460s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:51 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-7a3969a7-2cf9-4706-aac9-4686eba0dd0d tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:11:51 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-7a3969a7-2cf9-4706-aac9-4686eba0dd0d tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Deleted volume successfully. Apr 15 20:11:51 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7a3969a7-2cf9-4706-aac9-4686eba0dd0d tempest-VolumeQuotasNegativeTestJSON-1332199492 None] Lock "cinder-f2d921fc-d38c-4b93-b0bf-506d0a08c432-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:55 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:11:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Flow 'volume_create_manager' (af853c67-e99f-457d-a73d-e88f3fccb380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:11:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695fd40f-d2ce-45ca-98e9-7731a69b961b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695fd40f-d2ce-45ca-98e9-7731a69b961b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1120272918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee748613-1f15-493c-a06a-ff2478672f67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c14ed230df104f4f93985d3ce32b8799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:56Z,use_quota=True,user_id='0eb696b4f5174fcc8b67fdc5f7a7b0e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5817aef0-4892-4764-b4b2-669b53a733ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5817aef0-4892-4764-b4b2-669b53a733ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd19f393-ce81-40b0-a8bc-2d34281959d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd19f393-ce81-40b0-a8bc-2d34281959d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee748613-1f15-493c-a06a-ff2478672f67', 'volume_name': 'volume-ee748613-1f15-493c-a06a-ff2478672f67', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c207129-81c9-4fbb-b07e-cd402a768034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c207129-81c9-4fbb-b07e-cd402a768034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e388d318-6db4-4b94-87e4-49edcbf19936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:56 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Volume ee748613-1f15-493c-a06a-ff2478672f67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee748613-1f15-493c-a06a-ff2478672f67', 'volume_size': 1} Apr 15 20:11:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:56 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1120272918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee748613-1f15-493c-a06a-ff2478672f67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c14ed230df104f4f93985d3ce32b8799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:11:56Z,use_quota=True,user_id='0eb696b4f5174fcc8b67fdc5f7a7b0e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:11:56 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Creating volume ee748613-1f15-493c-a06a-ff2478672f67 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:11:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:11:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:11:56 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:11:56 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:11:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:56 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:11:56 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:11:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee748613-1f15-493c-a06a-ff2478672f67 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:56 devstack sudo[88944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee748613-1f15-493c-a06a-ff2478672f67 1073741824 Apr 15 20:11:56 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:56 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee748613-1f15-493c-a06a-ff2478672f67 1073741824" returned: 0 in 0.541s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee748613-1f15-493c-a06a-ff2478672f67 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:56 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee748613-1f15-493c-a06a-ff2478672f67 Apr 15 20:11:56 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:57 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee748613-1f15-493c-a06a-ff2478672f67" returned: 0 in 0.547s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:57 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:11:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:11:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e388d318-6db4-4b94-87e4-49edcbf19936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee748613-1f15-493c-a06a-ff2478672f67', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6916109-831b-49e0-bf77-c9203b02368c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:11:57 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Volume volume-ee748613-1f15-493c-a06a-ff2478672f67 (ee748613-1f15-493c-a06a-ff2478672f67): created successfully Apr 15 20:11:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6916109-831b-49e0-bf77-c9203b02368c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:11:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Flow 'volume_create_manager' (af853c67-e99f-457d-a73d-e88f3fccb380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:11:57 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-2924f773-3b16-41bc-aecb-d6b2886445ea tempest-VolumesTransfersV355Test-1562110214 None] Created volume successfully. Apr 15 20:11:58 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-f95bc5a1-ea9c-4836-b6c3-0e2b3b5e108b tempest-VolumesTransfersV355Test-1061347492 None] Transfer volume completed successfully. Apr 15 20:11:59 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-edb06b17-c0c0-4ff5-bf45-1ebc9ba9cf6a tempest-VolumesTransfersV355Test-9182293 None] Acquiring lock "cinder-ee748613-1f15-493c-a06a-ff2478672f67-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:59 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-edb06b17-c0c0-4ff5-bf45-1ebc9ba9cf6a tempest-VolumesTransfersV355Test-9182293 None] Lock "cinder-ee748613-1f15-493c-a06a-ff2478672f67-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:59 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-edb06b17-c0c0-4ff5-bf45-1ebc9ba9cf6a tempest-VolumesTransfersV355Test-9182293 None] Acquiring lock "cinder-quobyte-ee748613-1f15-493c-a06a-ff2478672f67" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:59 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-edb06b17-c0c0-4ff5-bf45-1ebc9ba9cf6a tempest-VolumesTransfersV355Test-9182293 None] Lock "cinder-quobyte-ee748613-1f15-493c-a06a-ff2478672f67" acquired by "delete_volume" :: waited 0.013s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:59 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f168a2-7d76-4e97-b9fc-1bb1f95a411a]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:11:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-edb06b17-c0c0-4ff5-bf45-1ebc9ba9cf6a tempest-VolumesTransfersV355Test-9182293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee748613-1f15-493c-a06a-ff2478672f67 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:59 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee748613-1f15-493c-a06a-ff2478672f67 Apr 15 20:11:59 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:11:59 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1361a8c6-1f8a-4742-8e3d-2eb2ad17b458 tempest-VolumesActionsTest-1052978251 None] Acquiring lock "cinder-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc" by "attach_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:11:59 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1361a8c6-1f8a-4742-8e3d-2eb2ad17b458 tempest-VolumesActionsTest-1052978251 None] Lock "cinder-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc" acquired by "attach_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:11:59 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-1361a8c6-1f8a-4742-8e3d-2eb2ad17b458 tempest-VolumesActionsTest-1052978251 None] Attaching volume 310cde1c-2965-46ca-a8b2-60fc5c7c5ddc to instance 7048f13f-5d93-4bca-8fd0-2e43ff26a216 at mountpoint /dev/vdb on host None. Apr 15 20:11:59 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-1361a8c6-1f8a-4742-8e3d-2eb2ad17b458 tempest-VolumesActionsTest-1052978251 None] Attach volume completed successfully. Apr 15 20:11:59 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1361a8c6-1f8a-4742-8e3d-2eb2ad17b458 tempest-VolumesActionsTest-1052978251 None] Lock "cinder-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc" released by "attach_volume" :: held 0.056s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:11:59 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Apr 15 20:11:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-edb06b17-c0c0-4ff5-bf45-1ebc9ba9cf6a tempest-VolumesTransfersV355Test-9182293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee748613-1f15-493c-a06a-ff2478672f67" returned: 0 in 0.576s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:11:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-edb06b17-c0c0-4ff5-bf45-1ebc9ba9cf6a tempest-VolumesTransfersV355Test-9182293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee748613-1f15-493c-a06a-ff2478672f67 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:11:59 devstack sudo[88985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee748613-1f15-493c-a06a-ff2478672f67 Apr 15 20:11:59 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:00 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-edb06b17-c0c0-4ff5-bf45-1ebc9ba9cf6a tempest-VolumesTransfersV355Test-9182293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ee748613-1f15-493c-a06a-ff2478672f67" returned: 0 in 0.495s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:00 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-edb06b17-c0c0-4ff5-bf45-1ebc9ba9cf6a tempest-VolumesTransfersV355Test-9182293 None] Lock "cinder-quobyte-ee748613-1f15-493c-a06a-ff2478672f67" released by "delete_volume" :: held 1.116s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:12:00 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d482cf8c-9258-4f78-bb31-ed5245905106 tempest-VolumesActionsTest-1052978251 None] Acquiring lock "cinder-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc-detach_volume" by "detach_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:12:00 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d482cf8c-9258-4f78-bb31-ed5245905106 tempest-VolumesActionsTest-1052978251 None] Lock "cinder-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:12:00 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-d482cf8c-9258-4f78-bb31-ed5245905106 tempest-VolumesActionsTest-1052978251 None] Detaching volume 310cde1c-2965-46ca-a8b2-60fc5c7c5ddc from instance 7048f13f-5d93-4bca-8fd0-2e43ff26a216. Apr 15 20:12:00 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-edb06b17-c0c0-4ff5-bf45-1ebc9ba9cf6a tempest-VolumesTransfersV355Test-9182293 None] Created reservations ['027c20e4-bfc9-45f7-b25b-d0f6acca8252', 'cefa477d-6fa5-430f-aa3a-cc684040ce68', '4d8ce19c-c97c-4869-9679-a40437940314', 'dec4b9c9-811e-45bb-8c30-1dba1f6190aa'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:12:00 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-d482cf8c-9258-4f78-bb31-ed5245905106 tempest-VolumesActionsTest-1052978251 None] Detach volume completed successfully. Apr 15 20:12:00 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d482cf8c-9258-4f78-bb31-ed5245905106 tempest-VolumesActionsTest-1052978251 None] Lock "cinder-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc-detach_volume" released by "detach_volume" :: held 0.074s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:12:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-edb06b17-c0c0-4ff5-bf45-1ebc9ba9cf6a tempest-VolumesTransfersV355Test-9182293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-edb06b17-c0c0-4ff5-bf45-1ebc9ba9cf6a tempest-VolumesTransfersV355Test-9182293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-edb06b17-c0c0-4ff5-bf45-1ebc9ba9cf6a tempest-VolumesTransfersV355Test-9182293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:12:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-edb06b17-c0c0-4ff5-bf45-1ebc9ba9cf6a tempest-VolumesTransfersV355Test-9182293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:12:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-edb06b17-c0c0-4ff5-bf45-1ebc9ba9cf6a tempest-VolumesTransfersV355Test-9182293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-edb06b17-c0c0-4ff5-bf45-1ebc9ba9cf6a tempest-VolumesTransfersV355Test-9182293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:00 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:12:00 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:01 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-edb06b17-c0c0-4ff5-bf45-1ebc9ba9cf6a tempest-VolumesTransfersV355Test-9182293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.458s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-edb06b17-c0c0-4ff5-bf45-1ebc9ba9cf6a tempest-VolumesTransfersV355Test-9182293 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:12:01 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-edb06b17-c0c0-4ff5-bf45-1ebc9ba9cf6a tempest-VolumesTransfersV355Test-9182293 None] Deleted volume successfully. Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-edb06b17-c0c0-4ff5-bf45-1ebc9ba9cf6a tempest-VolumesTransfersV355Test-9182293 None] Lock "cinder-ee748613-1f15-493c-a06a-ff2478672f67-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Flow 'volume_create_manager' (3d78b293-9ab2-4d2d-9db7-0cb0d4560041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e1ff22-32f0-4d24-a59f-965f7afdf7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e1ff22-32f0-4d24-a59f-965f7afdf7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-862976582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a29aff86-bfe6-43ce-9847-a478f3375b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c14ed230df104f4f93985d3ce32b8799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:02Z,use_quota=True,user_id='0eb696b4f5174fcc8b67fdc5f7a7b0e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed3537a-124f-40c1-b58b-1f6866c12512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed3537a-124f-40c1-b58b-1f6866c12512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53900d84-f0e9-450a-b6d8-5a9a88906da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53900d84-f0e9-450a-b6d8-5a9a88906da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a29aff86-bfe6-43ce-9847-a478f3375b63', 'volume_name': 'volume-a29aff86-bfe6-43ce-9847-a478f3375b63', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (903fbc5a-d7dd-4649-8e60-0e23986b354d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (903fbc5a-d7dd-4649-8e60-0e23986b354d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5416ebb-2199-4cd3-a639-849d6a45e0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:01 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Volume a29aff86-bfe6-43ce-9847-a478f3375b63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a29aff86-bfe6-43ce-9847-a478f3375b63', 'volume_size': 1} Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-862976582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a29aff86-bfe6-43ce-9847-a478f3375b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c14ed230df104f4f93985d3ce32b8799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:02Z,use_quota=True,user_id='0eb696b4f5174fcc8b67fdc5f7a7b0e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Creating volume a29aff86-bfe6-43ce-9847-a478f3375b63 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:12:01 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:12:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a29aff86-bfe6-43ce-9847-a478f3375b63 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:01 devstack sudo[88998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a29aff86-bfe6-43ce-9847-a478f3375b63 1073741824 Apr 15 20:12:01 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:02 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a29aff86-bfe6-43ce-9847-a478f3375b63 1073741824" returned: 0 in 0.549s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a29aff86-bfe6-43ce-9847-a478f3375b63 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:02 devstack sudo[89033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a29aff86-bfe6-43ce-9847-a478f3375b63 Apr 15 20:12:02 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:02 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a29aff86-bfe6-43ce-9847-a478f3375b63" returned: 0 in 0.428s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:02 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:12:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5416ebb-2199-4cd3-a639-849d6a45e0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a29aff86-bfe6-43ce-9847-a478f3375b63', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5015b8b4-94e0-4ae2-8f35-b0d08e59b386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:02 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Volume volume-a29aff86-bfe6-43ce-9847-a478f3375b63 (a29aff86-bfe6-43ce-9847-a478f3375b63): created successfully Apr 15 20:12:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5015b8b4-94e0-4ae2-8f35-b0d08e59b386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Flow 'volume_create_manager' (3d78b293-9ab2-4d2d-9db7-0cb0d4560041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:12:02 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-275bef48-7278-4316-94c0-58ab1f60b737 tempest-VolumesTransfersV355Test-1562110214 None] Created volume successfully. Apr 15 20:12:04 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dd52792b-6845-4a3c-9ada-a09e45213eaa tempest-VolumesTransfersV355Test-9182293 None] Acquiring lock "cinder-a29aff86-bfe6-43ce-9847-a478f3375b63-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:12:04 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dd52792b-6845-4a3c-9ada-a09e45213eaa tempest-VolumesTransfersV355Test-9182293 None] Lock "cinder-a29aff86-bfe6-43ce-9847-a478f3375b63-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:12:04 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dd52792b-6845-4a3c-9ada-a09e45213eaa tempest-VolumesTransfersV355Test-9182293 None] Acquiring lock "cinder-quobyte-a29aff86-bfe6-43ce-9847-a478f3375b63" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:12:04 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dd52792b-6845-4a3c-9ada-a09e45213eaa tempest-VolumesTransfersV355Test-9182293 None] Lock "cinder-quobyte-a29aff86-bfe6-43ce-9847-a478f3375b63" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:12:04 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d874fe-9736-4219-9127-1ea1db8c87c2]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dd52792b-6845-4a3c-9ada-a09e45213eaa tempest-VolumesTransfersV355Test-9182293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a29aff86-bfe6-43ce-9847-a478f3375b63 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:04 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a29aff86-bfe6-43ce-9847-a478f3375b63 Apr 15 20:12:04 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:04 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dd52792b-6845-4a3c-9ada-a09e45213eaa tempest-VolumesTransfersV355Test-9182293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a29aff86-bfe6-43ce-9847-a478f3375b63" returned: 0 in 0.464s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dd52792b-6845-4a3c-9ada-a09e45213eaa tempest-VolumesTransfersV355Test-9182293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a29aff86-bfe6-43ce-9847-a478f3375b63 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:04 devstack sudo[89044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a29aff86-bfe6-43ce-9847-a478f3375b63 Apr 15 20:12:04 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:05 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dd52792b-6845-4a3c-9ada-a09e45213eaa tempest-VolumesTransfersV355Test-9182293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a29aff86-bfe6-43ce-9847-a478f3375b63" returned: 0 in 0.422s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dd52792b-6845-4a3c-9ada-a09e45213eaa tempest-VolumesTransfersV355Test-9182293 None] Lock "cinder-quobyte-a29aff86-bfe6-43ce-9847-a478f3375b63" released by "delete_volume" :: held 0.914s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:12:05 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-dd52792b-6845-4a3c-9ada-a09e45213eaa tempest-VolumesTransfersV355Test-9182293 None] Created reservations ['3f95e877-ff39-4099-9c3a-19ab2c77a612', 'd6d551b3-b4f2-414c-8b16-2f6a215bcde6', 'e0296502-b3eb-465c-822e-9a1cdba36535', '5fec41e5-35ba-41b3-8aa4-be52ee054aeb'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:12:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dd52792b-6845-4a3c-9ada-a09e45213eaa tempest-VolumesTransfersV355Test-9182293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dd52792b-6845-4a3c-9ada-a09e45213eaa tempest-VolumesTransfersV355Test-9182293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-dd52792b-6845-4a3c-9ada-a09e45213eaa tempest-VolumesTransfersV355Test-9182293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:12:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-dd52792b-6845-4a3c-9ada-a09e45213eaa tempest-VolumesTransfersV355Test-9182293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:12:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dd52792b-6845-4a3c-9ada-a09e45213eaa tempest-VolumesTransfersV355Test-9182293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dd52792b-6845-4a3c-9ada-a09e45213eaa tempest-VolumesTransfersV355Test-9182293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:05 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:12:05 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:05 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dd52792b-6845-4a3c-9ada-a09e45213eaa tempest-VolumesTransfersV355Test-9182293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.481s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:05 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-dd52792b-6845-4a3c-9ada-a09e45213eaa tempest-VolumesTransfersV355Test-9182293 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:12:05 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-dd52792b-6845-4a3c-9ada-a09e45213eaa tempest-VolumesTransfersV355Test-9182293 None] Deleted volume successfully. Apr 15 20:12:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dd52792b-6845-4a3c-9ada-a09e45213eaa tempest-VolumesTransfersV355Test-9182293 None] Lock "cinder-a29aff86-bfe6-43ce-9847-a478f3375b63-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:12:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dd77447b-d1f1-4a73-beb7-c558b1bf55c4 tempest-VolumesActionsTest-1052978251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dd77447b-d1f1-4a73-beb7-c558b1bf55c4 tempest-VolumesActionsTest-1052978251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:08 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[2018573d-7192-448a-9f2d-35ec561484cc]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dd77447b-d1f1-4a73-beb7-c558b1bf55c4 tempest-VolumesActionsTest-1052978251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:08 devstack sudo[89050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc Apr 15 20:12:08 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:08 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dd77447b-d1f1-4a73-beb7-c558b1bf55c4 tempest-VolumesActionsTest-1052978251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc" returned: 0 in 0.560s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:08 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08660e2-1c3a-4df6-8b82-303417325426]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dd77447b-d1f1-4a73-beb7-c558b1bf55c4 tempest-VolumesActionsTest-1052978251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:09 devstack sudo[89087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc Apr 15 20:12:09 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:09 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:12:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Flow 'volume_create_manager' (f3e12ebf-02ef-4009-9acc-3dd9d32c2475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:12:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb82711-84b0-415c-b690-4fd1d54eb902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb82711-84b0-415c-b690-4fd1d54eb902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-991662237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f834919-d479-4ddc-8219-3be177863b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='935aad642c1d47d9a4d4965e9eaaf2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:09Z,use_quota=True,user_id='5eace5e5fa9d4f0091d76ac36e09b99b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22203fe2-3c48-4464-8579-d46174e25633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22203fe2-3c48-4464-8579-d46174e25633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a433fb0b-891e-4bec-80dc-e7e7eea4664d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a433fb0b-891e-4bec-80dc-e7e7eea4664d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f834919-d479-4ddc-8219-3be177863b49', 'volume_name': 'volume-6f834919-d479-4ddc-8219-3be177863b49', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae144ade-df76-4d97-b4b6-b21c6395b276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae144ade-df76-4d97-b4b6-b21c6395b276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a500e35-f067-443c-afed-59ca2abd467e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:09 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Volume 6f834919-d479-4ddc-8219-3be177863b49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f834919-d479-4ddc-8219-3be177863b49', 'volume_size': 1} Apr 15 20:12:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:09 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dd77447b-d1f1-4a73-beb7-c558b1bf55c4 tempest-VolumesActionsTest-1052978251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc" returned: 0 in 0.501s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dd77447b-d1f1-4a73-beb7-c558b1bf55c4 tempest-VolumesActionsTest-1052978251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc /opt/stack/data/cinder/conversion/310cde1c-2965-46ca-a8b2-60fc5c7c5ddc.temp_image.93656db1-53cd-4b2f-a0c8-3d07042c6d5cy0hun30g.img {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:09 devstack sudo[89094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc /opt/stack/data/cinder/conversion/310cde1c-2965-46ca-a8b2-60fc5c7c5ddc.temp_image.93656db1-53cd-4b2f-a0c8-3d07042c6d5cy0hun30g.img Apr 15 20:12:09 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:11 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dd77447b-d1f1-4a73-beb7-c558b1bf55c4 tempest-VolumesActionsTest-1052978251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc /opt/stack/data/cinder/conversion/310cde1c-2965-46ca-a8b2-60fc5c7c5ddc.temp_image.93656db1-53cd-4b2f-a0c8-3d07042c6d5cy0hun30g.img" returned: 0 in 1.815s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:11 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f966b7-e81d-42e0-809e-ecedaa426abb]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dd77447b-d1f1-4a73-beb7-c558b1bf55c4 tempest-VolumesActionsTest-1052978251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:11 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc Apr 15 20:12:11 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:11 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dd77447b-d1f1-4a73-beb7-c558b1bf55c4 tempest-VolumesActionsTest-1052978251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc" returned: 0 in 0.563s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:11 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-dd77447b-d1f1-4a73-beb7-c558b1bf55c4 tempest-VolumesActionsTest-1052978251 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc, size 1024.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/conversion/310cde1c-2965-46ca-a8b2-60fc5c7c5ddc.temp_image.93656db1-53cd-4b2f-a0c8-3d07042c6d5cy0hun30g.img {{(pid=82989) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 20:12:11 devstack cinder-volume[82989]: INFO cinder.image.image_utils [None req-dd77447b-d1f1-4a73-beb7-c558b1bf55c4 tempest-VolumesActionsTest-1052978251 None] Converted 1024.00 MB image at 563.83 MB/s Apr 15 20:12:11 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-dd77447b-d1f1-4a73-beb7-c558b1bf55c4 tempest-VolumesActionsTest-1052978251 None] 93656db1-53cd-4b2f-a0c8-3d07042c6d5c was raw, no need to convert to raw {{(pid=82989) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 15 20:12:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dd77447b-d1f1-4a73-beb7-c558b1bf55c4 tempest-VolumesActionsTest-1052978251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.824s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-dd77447b-d1f1-4a73-beb7-c558b1bf55c4 tempest-VolumesActionsTest-1052978251 None] Uploaded volume to glance image-id: 93656db1-53cd-4b2f-a0c8-3d07042c6d5c. {{(pid=82989) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 15 20:12:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.802s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-991662237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f834919-d479-4ddc-8219-3be177863b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='935aad642c1d47d9a4d4965e9eaaf2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:09Z,use_quota=True,user_id='5eace5e5fa9d4f0091d76ac36e09b99b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:12:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Creating volume 6f834919-d479-4ddc-8219-3be177863b49 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:12:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:12:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:12:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:12:21 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:12:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6f834919-d479-4ddc-8219-3be177863b49 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:21 devstack sudo[89114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6f834919-d479-4ddc-8219-3be177863b49 1073741824 Apr 15 20:12:21 devstack cinder-volume[82989]: DEBUG dbcounter [-] [82989] Writing DB stats cinder:DELETE=6,cinder:SELECT=88,cinder:INSERT=28,cinder:UPDATE=100 {{(pid=82989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:12:21 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:21 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-dd77447b-d1f1-4a73-beb7-c558b1bf55c4 tempest-VolumesActionsTest-1052978251 None] Copy volume to image completed successfully. Apr 15 20:12:21 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6f834919-d479-4ddc-8219-3be177863b49 1073741824" returned: 0 in 0.481s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6f834919-d479-4ddc-8219-3be177863b49 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:21 devstack sudo[89119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6f834919-d479-4ddc-8219-3be177863b49 Apr 15 20:12:21 devstack sudo[89119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:22 devstack sudo[89119]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6f834919-d479-4ddc-8219-3be177863b49" returned: 0 in 0.432s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:22 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:12:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a500e35-f067-443c-afed-59ca2abd467e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f834919-d479-4ddc-8219-3be177863b49', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ad1e27-bcbe-46e0-b94a-6b1570a4d867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:22 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Volume volume-6f834919-d479-4ddc-8219-3be177863b49 (6f834919-d479-4ddc-8219-3be177863b49): created successfully Apr 15 20:12:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ad1e27-bcbe-46e0-b94a-6b1570a4d867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Flow 'volume_create_manager' (f3e12ebf-02ef-4009-9acc-3dd9d32c2475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:12:22 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-2f6364e6-8437-41a0-b990-02b6a8d8384f tempest-VolumesTransfersV357Test-1551621654 None] Created volume successfully. Apr 15 20:12:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:22 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd82786-84fe-4bab-9bc7-a7c5e1b7e605]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:22 devstack sudo[89123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc Apr 15 20:12:22 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:22 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc" returned: 0 in 0.451s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:22 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35bcad3-e869-4593-a39b-9b00e9c876d7]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:22 devstack sudo[89128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc Apr 15 20:12:22 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:23 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc" returned: 0 in 0.464s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc /opt/stack/data/cinder/conversion/310cde1c-2965-46ca-a8b2-60fc5c7c5ddc.temp_image.dfaa92d7-4e22-4cd9-88ed-2fec4fae6db0jkpazt9g.img {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:23 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc /opt/stack/data/cinder/conversion/310cde1c-2965-46ca-a8b2-60fc5c7c5ddc.temp_image.dfaa92d7-4e22-4cd9-88ed-2fec4fae6db0jkpazt9g.img Apr 15 20:12:23 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:23 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-d3fe1425-34db-4739-9fa6-0189efdc9bef tempest-VolumesTransfersV357Test-669095642 None] Transfer volume completed successfully. Apr 15 20:12:24 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2faea061-5b86-4f21-913f-b3bff71a6fde tempest-VolumesTransfersV357Test-1398886726 None] Acquiring lock "cinder-6f834919-d479-4ddc-8219-3be177863b49-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:12:24 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2faea061-5b86-4f21-913f-b3bff71a6fde tempest-VolumesTransfersV357Test-1398886726 None] Lock "cinder-6f834919-d479-4ddc-8219-3be177863b49-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:12:24 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2faea061-5b86-4f21-913f-b3bff71a6fde tempest-VolumesTransfersV357Test-1398886726 None] Acquiring lock "cinder-quobyte-6f834919-d479-4ddc-8219-3be177863b49" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:12:24 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2faea061-5b86-4f21-913f-b3bff71a6fde tempest-VolumesTransfersV357Test-1398886726 None] Lock "cinder-quobyte-6f834919-d479-4ddc-8219-3be177863b49" acquired by "delete_volume" :: waited 0.013s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:12:24 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90dd74e-9cf0-4dc6-be27-249637f88829]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2faea061-5b86-4f21-913f-b3bff71a6fde tempest-VolumesTransfersV357Test-1398886726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6f834919-d479-4ddc-8219-3be177863b49 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:25 devstack sudo[89145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6f834919-d479-4ddc-8219-3be177863b49 Apr 15 20:12:25 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:25 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc /opt/stack/data/cinder/conversion/310cde1c-2965-46ca-a8b2-60fc5c7c5ddc.temp_image.dfaa92d7-4e22-4cd9-88ed-2fec4fae6db0jkpazt9g.img" returned: 0 in 1.860s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:25 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df39c5b-236e-4119-a14f-27f9a192a035]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:25 devstack sudo[89147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc Apr 15 20:12:25 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:25 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2faea061-5b86-4f21-913f-b3bff71a6fde tempest-VolumesTransfersV357Test-1398886726 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6f834919-d479-4ddc-8219-3be177863b49" returned: 0 in 0.502s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2faea061-5b86-4f21-913f-b3bff71a6fde tempest-VolumesTransfersV357Test-1398886726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6f834919-d479-4ddc-8219-3be177863b49 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:25 devstack sudo[89152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6f834919-d479-4ddc-8219-3be177863b49 Apr 15 20:12:25 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:25 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc" returned: 0 in 0.567s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:25 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc, size 1024.00 MB, duration 1.86 sec, destination /opt/stack/data/cinder/conversion/310cde1c-2965-46ca-a8b2-60fc5c7c5ddc.temp_image.dfaa92d7-4e22-4cd9-88ed-2fec4fae6db0jkpazt9g.img {{(pid=82989) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 20:12:25 devstack cinder-volume[82989]: INFO cinder.image.image_utils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] Converted 1024.00 MB image at 550.24 MB/s Apr 15 20:12:25 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] dfaa92d7-4e22-4cd9-88ed-2fec4fae6db0 was raw, converting to qcow2 {{(pid=82989) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 15 20:12:25 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e66223-742e-4a87-8074-bda9650f2c03]: (4, 'raw') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/310cde1c-2965-46ca-a8b2-60fc5c7c5ddc.temp_image.dfaa92d7-4e22-4cd9-88ed-2fec4fae6db0jkpazt9g.img {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:25 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/310cde1c-2965-46ca-a8b2-60fc5c7c5ddc.temp_image.dfaa92d7-4e22-4cd9-88ed-2fec4fae6db0jkpazt9g.img Apr 15 20:12:25 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:25 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2faea061-5b86-4f21-913f-b3bff71a6fde tempest-VolumesTransfersV357Test-1398886726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6f834919-d479-4ddc-8219-3be177863b49" returned: 0 in 0.405s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2faea061-5b86-4f21-913f-b3bff71a6fde tempest-VolumesTransfersV357Test-1398886726 None] Lock "cinder-quobyte-6f834919-d479-4ddc-8219-3be177863b49" released by "delete_volume" :: held 0.945s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:12:26 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/310cde1c-2965-46ca-a8b2-60fc5c7c5ddc.temp_image.dfaa92d7-4e22-4cd9-88ed-2fec4fae6db0jkpazt9g.img" returned: 0 in 0.481s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/310cde1c-2965-46ca-a8b2-60fc5c7c5ddc.temp_image.dfaa92d7-4e22-4cd9-88ed-2fec4fae6db0jkpazt9g.img {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:26 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/310cde1c-2965-46ca-a8b2-60fc5c7c5ddc.temp_image.dfaa92d7-4e22-4cd9-88ed-2fec4fae6db0jkpazt9g.img Apr 15 20:12:26 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:26 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-2faea061-5b86-4f21-913f-b3bff71a6fde tempest-VolumesTransfersV357Test-1398886726 None] Created reservations ['da2c193f-5130-434b-b99c-0972e202ca49', '859786dc-d065-4a71-920e-3f99ea63af40', '03dd21a8-2e37-48e8-aebd-6027bbf6a996', 'a43a5053-b1e0-4766-a0f1-5286bc15ccd8'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:12:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2faea061-5b86-4f21-913f-b3bff71a6fde tempest-VolumesTransfersV357Test-1398886726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2faea061-5b86-4f21-913f-b3bff71a6fde tempest-VolumesTransfersV357Test-1398886726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:26 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2faea061-5b86-4f21-913f-b3bff71a6fde tempest-VolumesTransfersV357Test-1398886726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:12:26 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2faea061-5b86-4f21-913f-b3bff71a6fde tempest-VolumesTransfersV357Test-1398886726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:12:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2faea061-5b86-4f21-913f-b3bff71a6fde tempest-VolumesTransfersV357Test-1398886726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2faea061-5b86-4f21-913f-b3bff71a6fde tempest-VolumesTransfersV357Test-1398886726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:26 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:12:26 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:26 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/310cde1c-2965-46ca-a8b2-60fc5c7c5ddc.temp_image.dfaa92d7-4e22-4cd9-88ed-2fec4fae6db0jkpazt9g.img" returned: 1 in 0.494s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/310cde1c-2965-46ca-a8b2-60fc5c7c5ddc.temp_image.dfaa92d7-4e22-4cd9-88ed-2fec4fae6db0jkpazt9g.img' failed. Not Retrying. {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 20:12:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/310cde1c-2965-46ca-a8b2-60fc5c7c5ddc.temp_image.dfaa92d7-4e22-4cd9-88ed-2fec4fae6db0jkpazt9g.img /opt/stack/data/cinder/conversion/vol_upload_g2f1l987 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:26 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/310cde1c-2965-46ca-a8b2-60fc5c7c5ddc.temp_image.dfaa92d7-4e22-4cd9-88ed-2fec4fae6db0jkpazt9g.img /opt/stack/data/cinder/conversion/vol_upload_g2f1l987 Apr 15 20:12:26 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:26 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2faea061-5b86-4f21-913f-b3bff71a6fde tempest-VolumesTransfersV357Test-1398886726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.387s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:26 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-2faea061-5b86-4f21-913f-b3bff71a6fde tempest-VolumesTransfersV357Test-1398886726 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:12:26 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-2faea061-5b86-4f21-913f-b3bff71a6fde tempest-VolumesTransfersV357Test-1398886726 None] Deleted volume successfully. Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2faea061-5b86-4f21-913f-b3bff71a6fde tempest-VolumesTransfersV357Test-1398886726 None] Lock "cinder-6f834919-d479-4ddc-8219-3be177863b49-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:12:27 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/310cde1c-2965-46ca-a8b2-60fc5c7c5ddc.temp_image.dfaa92d7-4e22-4cd9-88ed-2fec4fae6db0jkpazt9g.img /opt/stack/data/cinder/conversion/vol_upload_g2f1l987" returned: 0 in 0.414s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] Image conversion details: src /opt/stack/data/cinder/conversion/310cde1c-2965-46ca-a8b2-60fc5c7c5ddc.temp_image.dfaa92d7-4e22-4cd9-88ed-2fec4fae6db0jkpazt9g.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_g2f1l987 {{(pid=82989) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 20:12:27 devstack cinder-volume[82989]: INFO cinder.image.image_utils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[130bb0ab-6a8e-4371-b2ba-c297a26033f4]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_g2f1l987 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:27 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_g2f1l987 Apr 15 20:12:27 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Flow 'volume_create_manager' (61f56168-9743-4d73-905c-fdaafecac107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ecd2c61-365e-4d48-975c-c08c70fb6441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ecd2c61-365e-4d48-975c-c08c70fb6441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1209379135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a710f01f-f184-438d-88cb-f2e0b9e29056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='935aad642c1d47d9a4d4965e9eaaf2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:27Z,use_quota=True,user_id='5eace5e5fa9d4f0091d76ac36e09b99b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e096468-7445-433e-b9ea-2b5db5c47607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e096468-7445-433e-b9ea-2b5db5c47607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829b8320-7aed-4c3b-a31b-80012f4b574f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829b8320-7aed-4c3b-a31b-80012f4b574f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a710f01f-f184-438d-88cb-f2e0b9e29056', 'volume_name': 'volume-a710f01f-f184-438d-88cb-f2e0b9e29056', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d5a005a-2a30-4c4c-a6c9-808cea0f6f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d5a005a-2a30-4c4c-a6c9-808cea0f6f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879acdd6-dcea-48bc-8143-43e8b96c732b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:27 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Volume a710f01f-f184-438d-88cb-f2e0b9e29056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a710f01f-f184-438d-88cb-f2e0b9e29056', 'volume_size': 1} Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:27 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_g2f1l987" returned: 0 in 0.484s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG oslo_service.periodic_task [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82989) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:27 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:12:27 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:28 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.421s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:28 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:12:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.042s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:28 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] Uploaded volume to glance image-id: dfaa92d7-4e22-4cd9-88ed-2fec4fae6db0. {{(pid=82989) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 15 20:12:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:28 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1209379135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a710f01f-f184-438d-88cb-f2e0b9e29056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='935aad642c1d47d9a4d4965e9eaaf2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:27Z,use_quota=True,user_id='5eace5e5fa9d4f0091d76ac36e09b99b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:12:28 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Creating volume a710f01f-f184-438d-88cb-f2e0b9e29056 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:12:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:28 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:12:28 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:12:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:28 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:12:28 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:12:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a710f01f-f184-438d-88cb-f2e0b9e29056 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:28 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-a3af7ade-bdeb-4710-89bd-d28aca26933b tempest-VolumesActionsTest-1052978251 None] Copy volume to image completed successfully. Apr 15 20:12:28 devstack sudo[89183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a710f01f-f184-438d-88cb-f2e0b9e29056 1073741824 Apr 15 20:12:28 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:28 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-c436ee56-f753-45a9-9782-68d7ff9ce2c0 tempest-VolumesActionsTest-1052978251 None] Acquiring lock "cinder-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:12:28 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-c436ee56-f753-45a9-9782-68d7ff9ce2c0 tempest-VolumesActionsTest-1052978251 None] Lock "cinder-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:12:28 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-c436ee56-f753-45a9-9782-68d7ff9ce2c0 tempest-VolumesActionsTest-1052978251 None] Acquiring lock "cinder-quobyte-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:12:28 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-c436ee56-f753-45a9-9782-68d7ff9ce2c0 tempest-VolumesActionsTest-1052978251 None] Lock "cinder-quobyte-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:12:28 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a710f01f-f184-438d-88cb-f2e0b9e29056 1073741824" returned: 0 in 0.544s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:28 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d24da87-6ce1-4b11-9df7-8bee44b5b113]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c436ee56-f753-45a9-9782-68d7ff9ce2c0 tempest-VolumesActionsTest-1052978251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a710f01f-f184-438d-88cb-f2e0b9e29056 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:28 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a710f01f-f184-438d-88cb-f2e0b9e29056 Apr 15 20:12:28 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:28 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc Apr 15 20:12:28 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:29 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a710f01f-f184-438d-88cb-f2e0b9e29056" returned: 0 in 0.420s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:12:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879acdd6-dcea-48bc-8143-43e8b96c732b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a710f01f-f184-438d-88cb-f2e0b9e29056', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:29 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba3b2109-5aa6-40cb-affd-2ce6dc89e7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c436ee56-f753-45a9-9782-68d7ff9ce2c0 tempest-VolumesActionsTest-1052978251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc" returned: 0 in 0.465s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c436ee56-f753-45a9-9782-68d7ff9ce2c0 tempest-VolumesActionsTest-1052978251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:29 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Volume volume-a710f01f-f184-438d-88cb-f2e0b9e29056 (a710f01f-f184-438d-88cb-f2e0b9e29056): created successfully Apr 15 20:12:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba3b2109-5aa6-40cb-affd-2ce6dc89e7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:29 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc Apr 15 20:12:29 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Flow 'volume_create_manager' (61f56168-9743-4d73-905c-fdaafecac107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:12:29 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-514751af-3745-4724-b4c3-5510cdbb4757 tempest-VolumesTransfersV357Test-1551621654 None] Created volume successfully. Apr 15 20:12:29 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c436ee56-f753-45a9-9782-68d7ff9ce2c0 tempest-VolumesActionsTest-1052978251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc" returned: 0 in 0.405s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:29 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-c436ee56-f753-45a9-9782-68d7ff9ce2c0 tempest-VolumesActionsTest-1052978251 None] Lock "cinder-quobyte-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc" released by "delete_volume" :: held 0.890s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:12:29 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-c436ee56-f753-45a9-9782-68d7ff9ce2c0 tempest-VolumesActionsTest-1052978251 None] Created reservations ['2760e741-b783-4d0c-a98c-474bc6105018', '76095073-9fdf-4cc4-b14a-e494d58a4f24', 'd6a4f9af-f0f9-447a-ba45-801b0229b9cb', '3f7942a0-f1d2-4170-bf6c-c34888438fea'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:12:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c436ee56-f753-45a9-9782-68d7ff9ce2c0 tempest-VolumesActionsTest-1052978251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c436ee56-f753-45a9-9782-68d7ff9ce2c0 tempest-VolumesActionsTest-1052978251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c436ee56-f753-45a9-9782-68d7ff9ce2c0 tempest-VolumesActionsTest-1052978251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:12:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c436ee56-f753-45a9-9782-68d7ff9ce2c0 tempest-VolumesActionsTest-1052978251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:12:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c436ee56-f753-45a9-9782-68d7ff9ce2c0 tempest-VolumesActionsTest-1052978251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c436ee56-f753-45a9-9782-68d7ff9ce2c0 tempest-VolumesActionsTest-1052978251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:29 devstack sudo[89199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:12:29 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:30 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c436ee56-f753-45a9-9782-68d7ff9ce2c0 tempest-VolumesActionsTest-1052978251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.416s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:30 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-c436ee56-f753-45a9-9782-68d7ff9ce2c0 tempest-VolumesActionsTest-1052978251 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:12:30 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-c436ee56-f753-45a9-9782-68d7ff9ce2c0 tempest-VolumesActionsTest-1052978251 None] Deleted volume successfully. Apr 15 20:12:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-c436ee56-f753-45a9-9782-68d7ff9ce2c0 tempest-VolumesActionsTest-1052978251 None] Lock "cinder-310cde1c-2965-46ca-a8b2-60fc5c7c5ddc-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:12:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-25a6ec08-8e99-419f-9fcc-395842d1a034 tempest-VolumesTransfersV357Test-1398886726 None] Acquiring lock "cinder-a710f01f-f184-438d-88cb-f2e0b9e29056-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:12:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-25a6ec08-8e99-419f-9fcc-395842d1a034 tempest-VolumesTransfersV357Test-1398886726 None] Lock "cinder-a710f01f-f184-438d-88cb-f2e0b9e29056-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:12:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-25a6ec08-8e99-419f-9fcc-395842d1a034 tempest-VolumesTransfersV357Test-1398886726 None] Acquiring lock "cinder-quobyte-a710f01f-f184-438d-88cb-f2e0b9e29056" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:12:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-25a6ec08-8e99-419f-9fcc-395842d1a034 tempest-VolumesTransfersV357Test-1398886726 None] Lock "cinder-quobyte-a710f01f-f184-438d-88cb-f2e0b9e29056" acquired by "delete_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:12:30 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6914e79-2233-4ecd-8c47-0c610f2d595a]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-25a6ec08-8e99-419f-9fcc-395842d1a034 tempest-VolumesTransfersV357Test-1398886726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a710f01f-f184-438d-88cb-f2e0b9e29056 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:30 devstack sudo[89202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a710f01f-f184-438d-88cb-f2e0b9e29056 Apr 15 20:12:30 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:31 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-25a6ec08-8e99-419f-9fcc-395842d1a034 tempest-VolumesTransfersV357Test-1398886726 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a710f01f-f184-438d-88cb-f2e0b9e29056" returned: 0 in 0.462s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-25a6ec08-8e99-419f-9fcc-395842d1a034 tempest-VolumesTransfersV357Test-1398886726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a710f01f-f184-438d-88cb-f2e0b9e29056 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:31 devstack sudo[89207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a710f01f-f184-438d-88cb-f2e0b9e29056 Apr 15 20:12:31 devstack sudo[89207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:31 devstack sudo[89207]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-25a6ec08-8e99-419f-9fcc-395842d1a034 tempest-VolumesTransfersV357Test-1398886726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-a710f01f-f184-438d-88cb-f2e0b9e29056" returned: 0 in 0.444s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:31 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-25a6ec08-8e99-419f-9fcc-395842d1a034 tempest-VolumesTransfersV357Test-1398886726 None] Lock "cinder-quobyte-a710f01f-f184-438d-88cb-f2e0b9e29056" released by "delete_volume" :: held 0.928s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:12:31 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-25a6ec08-8e99-419f-9fcc-395842d1a034 tempest-VolumesTransfersV357Test-1398886726 None] Created reservations ['343cff15-4d2a-4eef-a702-cc41a4d686de', 'd7728ad4-63f7-41f8-8e43-1f6e105d1ecb', 'e1c3485d-cf64-427a-8585-6f332abc05a9', 'f0acfda8-5750-4047-bb6f-da73931f9345'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:12:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-25a6ec08-8e99-419f-9fcc-395842d1a034 tempest-VolumesTransfersV357Test-1398886726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-25a6ec08-8e99-419f-9fcc-395842d1a034 tempest-VolumesTransfersV357Test-1398886726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:31 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-25a6ec08-8e99-419f-9fcc-395842d1a034 tempest-VolumesTransfersV357Test-1398886726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:12:31 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-25a6ec08-8e99-419f-9fcc-395842d1a034 tempest-VolumesTransfersV357Test-1398886726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:12:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-25a6ec08-8e99-419f-9fcc-395842d1a034 tempest-VolumesTransfersV357Test-1398886726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-25a6ec08-8e99-419f-9fcc-395842d1a034 tempest-VolumesTransfersV357Test-1398886726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:31 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:12:31 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:32 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-25a6ec08-8e99-419f-9fcc-395842d1a034 tempest-VolumesTransfersV357Test-1398886726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.612s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:32 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-25a6ec08-8e99-419f-9fcc-395842d1a034 tempest-VolumesTransfersV357Test-1398886726 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:12:32 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-25a6ec08-8e99-419f-9fcc-395842d1a034 tempest-VolumesTransfersV357Test-1398886726 None] Deleted volume successfully. Apr 15 20:12:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-25a6ec08-8e99-419f-9fcc-395842d1a034 tempest-VolumesTransfersV357Test-1398886726 None] Lock "cinder-a710f01f-f184-438d-88cb-f2e0b9e29056-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:12:34 devstack cinder-volume[82989]: DEBUG dbcounter [-] [82989] Writing DB stats cinder:UPDATE=92,cinder:SELECT=84,cinder:INSERT=28,cinder:DELETE=7 {{(pid=82989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:12:34 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:12:34 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Flow 'volume_create_manager' (3a91382f-963d-4469-a974-ac6d59b71163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:12:34 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d0f190-f74c-4a13-9fdf-849615b5c044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:34 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d0f190-f74c-4a13-9fdf-849615b5c044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1439841822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d13e5bf-6b66-4678-b710-b07863675614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16d93c0343994d3bbb65bb5192c945f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:35Z,use_quota=True,user_id='417d21d060554759a92cba87976ab9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:34 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03a73f6-9cb4-45f3-a995-f9aa564814f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:34 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03a73f6-9cb4-45f3-a995-f9aa564814f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:34 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f654884e-5d88-4ea2-a8bb-81222f1e170a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:34 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f654884e-5d88-4ea2-a8bb-81222f1e170a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d13e5bf-6b66-4678-b710-b07863675614', 'volume_name': 'volume-7d13e5bf-6b66-4678-b710-b07863675614', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:34 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc5b47d-847d-4a11-b8fa-0aadc4515c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:34 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc5b47d-847d-4a11-b8fa-0aadc4515c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:34 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78990d49-64c8-4101-8763-7f8bb566a0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:34 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Volume 7d13e5bf-6b66-4678-b710-b07863675614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d13e5bf-6b66-4678-b710-b07863675614', 'volume_size': 1} Apr 15 20:12:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1439841822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d13e5bf-6b66-4678-b710-b07863675614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16d93c0343994d3bbb65bb5192c945f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:35Z,use_quota=True,user_id='417d21d060554759a92cba87976ab9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:12:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Creating volume 7d13e5bf-6b66-4678-b710-b07863675614 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:12:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:12:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:12:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:12:34 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:12:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:34 devstack sudo[89217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614 1073741824 Apr 15 20:12:34 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:35 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614 1073741824" returned: 0 in 0.550s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:35 devstack sudo[89222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614 Apr 15 20:12:35 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:35 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614" returned: 0 in 0.442s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78990d49-64c8-4101-8763-7f8bb566a0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d13e5bf-6b66-4678-b710-b07863675614', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31791f5c-29b1-4396-9c03-1b0ab131dc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:35 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Volume volume-7d13e5bf-6b66-4678-b710-b07863675614 (7d13e5bf-6b66-4678-b710-b07863675614): created successfully Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31791f5c-29b1-4396-9c03-1b0ab131dc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Flow 'volume_create_manager' (3a91382f-963d-4469-a974-ac6d59b71163) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:12:35 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-27cee452-b5df-4b66-ae1d-cbe077de7f83 tempest-VolumesCloneTest-902691462 None] Created volume successfully. Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Flow 'volume_create_manager' (b92952f9-944d-44b1-9fa8-6e8cb8caba5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (838358d6-592f-478a-908d-17ef1228fcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (838358d6-592f-478a-908d-17ef1228fcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1974493467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f046b69-fb60-4dbf-bccb-27e5ec96fcdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55641d299887464da3d121dce17b0741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:36Z,use_quota=True,user_id='6a2f8ba8fc7c4ce69b8ebeec22aa696f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f475c9ef-a4de-4c61-932b-345db70121c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f475c9ef-a4de-4c61-932b-345db70121c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1939a8-13d1-4862-b566-28471887c21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1939a8-13d1-4862-b566-28471887c21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f046b69-fb60-4dbf-bccb-27e5ec96fcdd', 'volume_name': 'volume-1f046b69-fb60-4dbf-bccb-27e5ec96fcdd', 'volume_size': 2}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea057b7-4997-400d-ae93-a31a8a3600e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea057b7-4997-400d-ae93-a31a8a3600e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe84db44-679e-4f01-aec1-0d54ba53cc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:35 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Volume 1f046b69-fb60-4dbf-bccb-27e5ec96fcdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f046b69-fb60-4dbf-bccb-27e5ec96fcdd', 'volume_size': 2} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1974493467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f046b69-fb60-4dbf-bccb-27e5ec96fcdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55641d299887464da3d121dce17b0741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:36Z,use_quota=True,user_id='6a2f8ba8fc7c4ce69b8ebeec22aa696f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Creating volume 1f046b69-fb60-4dbf-bccb-27e5ec96fcdd {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:12:35 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:12:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1f046b69-fb60-4dbf-bccb-27e5ec96fcdd 2147483648 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:35 devstack sudo[89225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1f046b69-fb60-4dbf-bccb-27e5ec96fcdd 2147483648 Apr 15 20:12:35 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:36 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1f046b69-fb60-4dbf-bccb-27e5ec96fcdd 2147483648" returned: 0 in 0.461s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1f046b69-fb60-4dbf-bccb-27e5ec96fcdd {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:36 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1f046b69-fb60-4dbf-bccb-27e5ec96fcdd Apr 15 20:12:36 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:36 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1f046b69-fb60-4dbf-bccb-27e5ec96fcdd" returned: 0 in 0.396s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:36 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:12:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:36 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe84db44-679e-4f01-aec1-0d54ba53cc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f046b69-fb60-4dbf-bccb-27e5ec96fcdd', 'volume_size': 2}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:36 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dce4b24-d05d-457f-8ea3-88a8cfd9cf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:36 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Volume volume-1f046b69-fb60-4dbf-bccb-27e5ec96fcdd (1f046b69-fb60-4dbf-bccb-27e5ec96fcdd): created successfully Apr 15 20:12:36 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dce4b24-d05d-457f-8ea3-88a8cfd9cf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:36 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Flow 'volume_create_manager' (b92952f9-944d-44b1-9fa8-6e8cb8caba5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:12:36 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-7865b734-0e2f-4a4d-a98a-a670b74456d3 tempest-VolumesCloneNegativeTest-700898563 None] Created volume successfully. Apr 15 20:12:36 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:12:36 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Flow 'volume_create_manager' (8c492c44-276c-43ff-90c2-87a627ec0709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:12:36 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8326fd67-fa75-4187-a540-467d8f62fbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:36 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8027c319-59ea-44f6-875e-51ddda180ef7 tempest-VolumesCloneNegativeTest-700898563 None] Acquiring lock "cinder-1f046b69-fb60-4dbf-bccb-27e5ec96fcdd-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:12:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8326fd67-fa75-4187-a540-467d8f62fbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-604498999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2eee10f-2f42-49ba-8a6c-98c98cbadee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16d93c0343994d3bbb65bb5192c945f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=7d13e5bf-6b66-4678-b710-b07863675614,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:37Z,use_quota=True,user_id='417d21d060554759a92cba87976ab9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1ce584-f6f0-4f59-8d68-30e15c982dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1ce584-f6f0-4f59-8d68-30e15c982dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c449b48-98f1-4042-9ce9-87f50d253bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:37 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8027c319-59ea-44f6-875e-51ddda180ef7 tempest-VolumesCloneNegativeTest-700898563 None] Lock "cinder-1f046b69-fb60-4dbf-bccb-27e5ec96fcdd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:12:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c449b48-98f1-4042-9ce9-87f50d253bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c2eee10f-2f42-49ba-8a6c-98c98cbadee2', 'volume_name': 'volume-c2eee10f-2f42-49ba-8a6c-98c98cbadee2', 'volume_size': 2, 'source_volid': '7d13e5bf-6b66-4678-b710-b07863675614', 'source_volstatus': 'available'}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b096c7f-ebaa-4ca7-af7e-1b4d75b0eb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b096c7f-ebaa-4ca7-af7e-1b4d75b0eb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:37 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a893cef5-4b35-4ea6-9e25-dcde014cb2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:37 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Volume c2eee10f-2f42-49ba-8a6c-98c98cbadee2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c2eee10f-2f42-49ba-8a6c-98c98cbadee2', 'volume_size': 2, 'source_volid': '7d13e5bf-6b66-4678-b710-b07863675614', 'source_volstatus': 'available'} Apr 15 20:12:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:37 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Cloning volume 7d13e5bf-6b66-4678-b710-b07863675614 to volume c2eee10f-2f42-49ba-8a6c-98c98cbadee2 Apr 15 20:12:37 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8027c319-59ea-44f6-875e-51ddda180ef7 tempest-VolumesCloneNegativeTest-700898563 None] Acquiring lock "cinder-quobyte-1f046b69-fb60-4dbf-bccb-27e5ec96fcdd" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:12:37 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Creating offline snapshot 57d40479-fcf5-4b63-81df-b0f30b506c61 of volume 7d13e5bf-6b66-4678-b710-b07863675614 {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:12:37 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8027c319-59ea-44f6-875e-51ddda180ef7 tempest-VolumesCloneNegativeTest-700898563 None] Lock "cinder-quobyte-1f046b69-fb60-4dbf-bccb-27e5ec96fcdd" acquired by "delete_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:12:37 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd78e01-5ea3-4ea6-a658-e42030fc8aad]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:37 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[948ee09c-dd60-4cf4-afc1-b3ab7f4f84e5]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8027c319-59ea-44f6-875e-51ddda180ef7 tempest-VolumesCloneNegativeTest-700898563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1f046b69-fb60-4dbf-bccb-27e5ec96fcdd {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:37 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614 Apr 15 20:12:37 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:37 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1f046b69-fb60-4dbf-bccb-27e5ec96fcdd Apr 15 20:12:37 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:37 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614" returned: 0 in 0.466s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.57d40479-fcf5-4b63-81df-b0f30b506c61 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:37 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.57d40479-fcf5-4b63-81df-b0f30b506c61 1G Apr 15 20:12:37 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:37 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8027c319-59ea-44f6-875e-51ddda180ef7 tempest-VolumesCloneNegativeTest-700898563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1f046b69-fb60-4dbf-bccb-27e5ec96fcdd" returned: 0 in 0.485s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8027c319-59ea-44f6-875e-51ddda180ef7 tempest-VolumesCloneNegativeTest-700898563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1f046b69-fb60-4dbf-bccb-27e5ec96fcdd {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:37 devstack sudo[89245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1f046b69-fb60-4dbf-bccb-27e5ec96fcdd Apr 15 20:12:37 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:37 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8027c319-59ea-44f6-875e-51ddda180ef7 tempest-VolumesCloneNegativeTest-700898563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1f046b69-fb60-4dbf-bccb-27e5ec96fcdd" returned: 0 in 0.402s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:38 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8027c319-59ea-44f6-875e-51ddda180ef7 tempest-VolumesCloneNegativeTest-700898563 None] Lock "cinder-quobyte-1f046b69-fb60-4dbf-bccb-27e5ec96fcdd" released by "delete_volume" :: held 0.910s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:12:38 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.57d40479-fcf5-4b63-81df-b0f30b506c61 1G" returned: 0 in 0.498s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d13e5bf-6b66-4678-b710-b07863675614 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.57d40479-fcf5-4b63-81df-b0f30b506c61 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:38 devstack sudo[89251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d13e5bf-6b66-4678-b710-b07863675614 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.57d40479-fcf5-4b63-81df-b0f30b506c61 Apr 15 20:12:38 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:38 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-8027c319-59ea-44f6-875e-51ddda180ef7 tempest-VolumesCloneNegativeTest-700898563 None] Created reservations ['dcc6a762-de75-479f-8d6d-d57c2a5cf90f', '38b71ace-387f-49af-89b6-32f06be96d31', '0c25c590-c794-493e-8364-fc26d36eb13c', '2084e13d-7bdc-4f83-9576-139ffa9f5033'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:12:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8027c319-59ea-44f6-875e-51ddda180ef7 tempest-VolumesCloneNegativeTest-700898563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8027c319-59ea-44f6-875e-51ddda180ef7 tempest-VolumesCloneNegativeTest-700898563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:38 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-8027c319-59ea-44f6-875e-51ddda180ef7 tempest-VolumesCloneNegativeTest-700898563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:12:38 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-8027c319-59ea-44f6-875e-51ddda180ef7 tempest-VolumesCloneNegativeTest-700898563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:12:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8027c319-59ea-44f6-875e-51ddda180ef7 tempest-VolumesCloneNegativeTest-700898563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8027c319-59ea-44f6-875e-51ddda180ef7 tempest-VolumesCloneNegativeTest-700898563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:38 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:12:38 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:38 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d13e5bf-6b66-4678-b710-b07863675614 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.57d40479-fcf5-4b63-81df-b0f30b506c61" returned: 0 in 0.419s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:38 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.57d40479-fcf5-4b63-81df-b0f30b506c61 is being set with open permissions: ugo+rw Apr 15 20:12:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.57d40479-fcf5-4b63-81df-b0f30b506c61 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:38 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.57d40479-fcf5-4b63-81df-b0f30b506c61 Apr 15 20:12:38 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:38 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8027c319-59ea-44f6-875e-51ddda180ef7 tempest-VolumesCloneNegativeTest-700898563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.431s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:38 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-8027c319-59ea-44f6-875e-51ddda180ef7 tempest-VolumesCloneNegativeTest-700898563 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:12:38 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-8027c319-59ea-44f6-875e-51ddda180ef7 tempest-VolumesCloneNegativeTest-700898563 None] Deleted volume successfully. Apr 15 20:12:38 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8027c319-59ea-44f6-875e-51ddda180ef7 tempest-VolumesCloneNegativeTest-700898563 None] Lock "cinder-1f046b69-fb60-4dbf-bccb-27e5ec96fcdd-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:12:38 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.57d40479-fcf5-4b63-81df-b0f30b506c61" returned: 0 in 0.474s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:38 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.info Apr 15 20:12:38 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:39 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.info" returned: 0 in 0.435s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:39 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.info is being set with open permissions: ugo+rw Apr 15 20:12:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:39 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.info Apr 15 20:12:39 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:39 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.info" returned: 0 in 0.463s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Acquiring lock "cinder-quobyte-c2eee10f-2f42-49ba-8a6c-98c98cbadee2" by "_copy_volume_from_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:12:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Lock "cinder-quobyte-c2eee10f-2f42-49ba-8a6c-98c98cbadee2" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:12:39 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] snapshot: 57d40479-fcf5-4b63-81df-b0f30b506c61, volume: c2eee10f-2f42-49ba-8a6c-98c98cbadee2, {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 20:12:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:39 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:12:39 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:12:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:39 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[1559530f-881d-461b-96bb-5cd6eefa620a]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.57d40479-fcf5-4b63-81df-b0f30b506c61 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:39 devstack sudo[89268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.57d40479-fcf5-4b63-81df-b0f30b506c61 Apr 15 20:12:39 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:40 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.57d40479-fcf5-4b63-81df-b0f30b506c61" returned: 0 in 0.539s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d13e5bf-6b66-4678-b710-b07863675614(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:12:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614 {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 20:12:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Creating direct copy from snapshot {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 20:12:40 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac58a06-85d6-46a8-9784-f1f86c8f577c]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:40 devstack sudo[89273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614 Apr 15 20:12:40 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:40 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614" returned: 0 in 0.500s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:40 devstack cinder-volume[82989]: DEBUG cinder.utils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Path /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c2eee10f-2f42-49ba-8a6c-98c98cbadee2 not found in is_blk_device check {{(pid=82989) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 20:12:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c2eee10f-2f42-49ba-8a6c-98c98cbadee2 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:40 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c2eee10f-2f42-49ba-8a6c-98c98cbadee2 Apr 15 20:12:40 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:41 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:12:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Flow 'volume_create_manager' (d4748855-6cec-4afb-ba46-b5aad84f47b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:12:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (433e9461-e149-49da-a253-04cc0419b843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (433e9461-e149-49da-a253-04cc0419b843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1771166864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3e5226-d8f0-44a2-a589-2576047cc053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='926f8f9f4c474711a0a6366e4ef654d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:41Z,use_quota=True,user_id='8688edce03c24f79a55cd4802f927984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27e06f0-4a9c-4ff2-a43d-8f26b1617689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27e06f0-4a9c-4ff2-a43d-8f26b1617689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82cd8662-f589-4910-8a6a-f70f0202a688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:41 devstack cinder-volume[82989]: DEBUG cinder.image.glance [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Creating Keystone auth plugin from conf {{(pid=82989) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 20:12:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82cd8662-f589-4910-8a6a-f70f0202a688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0d3e5226-d8f0-44a2-a589-2576047cc053', 'volume_name': 'volume-0d3e5226-d8f0-44a2-a589-2576047cc053', 'volume_size': 1, 'image_id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f111d55abd084743b16b1c60d303fb2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c89b049d-8e9b-40a2-9350-466dd874c3a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b92687-8ce8-4199-9e37-71c8084299f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b92687-8ce8-4199-9e37-71c8084299f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9842a45-6bca-448a-890f-3a425c4484e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:41 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Volume 0d3e5226-d8f0-44a2-a589-2576047cc053: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0d3e5226-d8f0-44a2-a589-2576047cc053', 'volume_size': 1, 'image_id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f111d55abd084743b16b1c60d303fb2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c89b049d-8e9b-40a2-9350-466dd874c3a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 20:12:41 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Trying to clone 0d3e5226-d8f0-44a2-a589-2576047cc053 from image c89b049d-8e9b-40a2-9350-466dd874c3a8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}]). {{(pid=82989) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 20:12:41 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_t6648956devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82989) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 20:12:41 devstack cinder-volume[82989]: INFO cinder.image.image_utils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Image download 20.69 MB at 20.69 MB/s Apr 15 20:12:41 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[5456852d-b691-41b0-ac10-7b1a3f352875]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_t6648956devstack@QuobyteHD {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:42 devstack sudo[89291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_t6648956devstack@QuobyteHD Apr 15 20:12:42 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:43 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c2eee10f-2f42-49ba-8a6c-98c98cbadee2" returned: 0 in 2.071s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:43 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[703dece0-0e25-46d2-9ac5-d1217fa42be3]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:43 devstack sudo[89294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614 Apr 15 20:12:43 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:43 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_t6648956devstack@QuobyteHD" returned: 0 in 1.252s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:43 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Temporary image c89b049d-8e9b-40a2-9350-466dd874c3a8 is fetched for user 8688edce03c24f79a55cd4802f927984. {{(pid=82989) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 20:12:43 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[370d150d-6cfc-4693-844d-7297890af2e2]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_t6648956devstack@QuobyteHD {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:43 devstack sudo[89299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_t6648956devstack@QuobyteHD Apr 15 20:12:43 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:43 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614" returned: 0 in 0.593s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:43 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614, size 1024.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c2eee10f-2f42-49ba-8a6c-98c98cbadee2 {{(pid=82989) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 20:12:43 devstack cinder-volume[82989]: INFO cinder.image.image_utils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Converted 1024.00 MB image at 493.99 MB/s Apr 15 20:12:43 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c2eee10f-2f42-49ba-8a6c-98c98cbadee2 is being set with open permissions: ugo+rw Apr 15 20:12:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c2eee10f-2f42-49ba-8a6c-98c98cbadee2 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:43 devstack sudo[89304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c2eee10f-2f42-49ba-8a6c-98c98cbadee2 Apr 15 20:12:43 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:43 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_t6648956devstack@QuobyteHD" returned: 0 in 0.466s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:44 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c2eee10f-2f42-49ba-8a6c-98c98cbadee2" returned: 0 in 0.447s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:44 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Lock "cinder-quobyte-c2eee10f-2f42-49ba-8a6c-98c98cbadee2" released by "_copy_volume_from_snapshot" :: held 4.201s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:12:44 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Acquiring lock "cinder-quobyte-57d40479-fcf5-4b63-81df-b0f30b506c61" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:12:44 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Lock "cinder-quobyte-57d40479-fcf5-4b63-81df-b0f30b506c61" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:12:44 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Deleting offline snapshot 57d40479-fcf5-4b63-81df-b0f30b506c61 of volume 7d13e5bf-6b66-4678-b710-b07863675614 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:12:44 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] snapshot_file for this snap is: volume-7d13e5bf-6b66-4678-b710-b07863675614.57d40479-fcf5-4b63-81df-b0f30b506c61 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:12:44 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bee633-7fa8-4820-a126-4d47a9cdc997]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.57d40479-fcf5-4b63-81df-b0f30b506c61 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:44 devstack sudo[89310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.57d40479-fcf5-4b63-81df-b0f30b506c61 Apr 15 20:12:44 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:44 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.57d40479-fcf5-4b63-81df-b0f30b506c61" returned: 0 in 0.467s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:44 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d13e5bf-6b66-4678-b710-b07863675614(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:12:44 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd420535-6a6c-4816-a97a-04c27c65df74]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:44 devstack sudo[89315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614 Apr 15 20:12:44 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:45 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614" returned: 0 in 0.452s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.57d40479-fcf5-4b63-81df-b0f30b506c61 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:45 devstack sudo[89320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.57d40479-fcf5-4b63-81df-b0f30b506c61 Apr 15 20:12:45 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:45 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.57d40479-fcf5-4b63-81df-b0f30b506c61" returned: 0 in 0.413s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.57d40479-fcf5-4b63-81df-b0f30b506c61 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:45 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.57d40479-fcf5-4b63-81df-b0f30b506c61 Apr 15 20:12:45 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:45 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614.57d40479-fcf5-4b63-81df-b0f30b506c61" returned: 0 in 0.391s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:45 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Lock "cinder-quobyte-57d40479-fcf5-4b63-81df-b0f30b506c61" released by "_delete_snapshot" :: held 1.762s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:12:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.833s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.173s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:45 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1771166864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3e5226-d8f0-44a2-a589-2576047cc053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='926f8f9f4c474711a0a6366e4ef654d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:41Z,use_quota=True,user_id='8688edce03c24f79a55cd4802f927984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:12:45 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Creating volume 0d3e5226-d8f0-44a2-a589-2576047cc053 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:12:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:45 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:12:45 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:12:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:45 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:12:45 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:12:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a893cef5-4b35-4ea6-9e25-dcde014cb2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2eee10f-2f42-49ba-8a6c-98c98cbadee2', 'volume_size': 2, 'source_volid': '7d13e5bf-6b66-4678-b710-b07863675614', 'source_volstatus': 'available'}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:45 devstack sudo[89328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 1073741824 Apr 15 20:12:45 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c218445-6ead-445e-80f8-29b8c19ea54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:45 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Volume volume-c2eee10f-2f42-49ba-8a6c-98c98cbadee2 (c2eee10f-2f42-49ba-8a6c-98c98cbadee2): created successfully Apr 15 20:12:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c218445-6ead-445e-80f8-29b8c19ea54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Flow 'volume_create_manager' (8c492c44-276c-43ff-90c2-87a627ec0709) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:12:45 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-03508cd0-4df8-4569-b34f-72d0345d6987 tempest-VolumesCloneTest-902691462 None] Created volume successfully. Apr 15 20:12:46 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 1073741824" returned: 0 in 0.451s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:46 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 Apr 15 20:12:46 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:46 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5c516629-54fc-4e30-bfb6-a6fc53a6f133 tempest-VolumesCloneTest-902691462 None] Acquiring lock "cinder-c2eee10f-2f42-49ba-8a6c-98c98cbadee2-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:12:46 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053" returned: 0 in 0.422s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:46 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:12:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:46 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5c516629-54fc-4e30-bfb6-a6fc53a6f133 tempest-VolumesCloneTest-902691462 None] Lock "cinder-c2eee10f-2f42-49ba-8a6c-98c98cbadee2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:12:46 devstack cinder-volume[82989]: DEBUG cinder.volume.volume_utils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Attempting download of c89b049d-8e9b-40a2-9350-466dd874c3a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}])) to volume 0d3e5226-d8f0-44a2-a589-2576047cc053. {{(pid=82989) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 20:12:46 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5c516629-54fc-4e30-bfb6-a6fc53a6f133 tempest-VolumesCloneTest-902691462 None] Acquiring lock "cinder-quobyte-c2eee10f-2f42-49ba-8a6c-98c98cbadee2" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:12:46 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5c516629-54fc-4e30-bfb6-a6fc53a6f133 tempest-VolumesCloneTest-902691462 None] Lock "cinder-quobyte-c2eee10f-2f42-49ba-8a6c-98c98cbadee2" acquired by "delete_volume" :: waited 0.014s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:12:46 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[448386f1-17db-4a6d-9928-793d8468cc62]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:46 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06cbcd2-ba27-49d4-84cf-7e5ab5b1b05e]: (4, 'raw') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5c516629-54fc-4e30-bfb6-a6fc53a6f133 tempest-VolumesCloneTest-902691462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c2eee10f-2f42-49ba-8a6c-98c98cbadee2 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_wac6_274 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:46 devstack sudo[89336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c2eee10f-2f42-49ba-8a6c-98c98cbadee2 Apr 15 20:12:46 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:46 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_wac6_274 Apr 15 20:12:46 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:47 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_wac6_274" returned: 0 in 0.450s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_wac6_274 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:47 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5c516629-54fc-4e30-bfb6-a6fc53a6f133 tempest-VolumesCloneTest-902691462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c2eee10f-2f42-49ba-8a6c-98c98cbadee2" returned: 0 in 0.470s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5c516629-54fc-4e30-bfb6-a6fc53a6f133 tempest-VolumesCloneTest-902691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c2eee10f-2f42-49ba-8a6c-98c98cbadee2 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:47 devstack sudo[89346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c2eee10f-2f42-49ba-8a6c-98c98cbadee2 Apr 15 20:12:47 devstack sudo[89346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:47 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_wac6_274 Apr 15 20:12:47 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:47 devstack sudo[89346]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5c516629-54fc-4e30-bfb6-a6fc53a6f133 tempest-VolumesCloneTest-902691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c2eee10f-2f42-49ba-8a6c-98c98cbadee2" returned: 0 in 0.405s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:47 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5c516629-54fc-4e30-bfb6-a6fc53a6f133 tempest-VolumesCloneTest-902691462 None] Lock "cinder-quobyte-c2eee10f-2f42-49ba-8a6c-98c98cbadee2" released by "delete_volume" :: held 0.902s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:12:47 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-5c516629-54fc-4e30-bfb6-a6fc53a6f133 tempest-VolumesCloneTest-902691462 None] Created reservations ['fff28097-e058-48f5-8d6a-3c1d5c29a3b7', 'db162d6d-b074-407a-9464-d1d813ae3557', '3b8d06b6-f37a-4dd0-9a9d-abaeaffaf66d', 'eb99c3ab-e45e-4f3a-ae67-90f709ea0441'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:12:47 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_wac6_274" returned: 1 in 0.478s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c89b049d-8e9b-40a2-9350-466dd874c3a8_wac6_274' failed. Not Retrying. {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 20:12:47 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e2cef9-2979-4039-8d75-0b1ab4a93620]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_t6648956devstack@QuobyteHD {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5c516629-54fc-4e30-bfb6-a6fc53a6f133 tempest-VolumesCloneTest-902691462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5c516629-54fc-4e30-bfb6-a6fc53a6f133 tempest-VolumesCloneTest-902691462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:47 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-5c516629-54fc-4e30-bfb6-a6fc53a6f133 tempest-VolumesCloneTest-902691462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:12:47 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-5c516629-54fc-4e30-bfb6-a6fc53a6f133 tempest-VolumesCloneTest-902691462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:12:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5c516629-54fc-4e30-bfb6-a6fc53a6f133 tempest-VolumesCloneTest-902691462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5c516629-54fc-4e30-bfb6-a6fc53a6f133 tempest-VolumesCloneTest-902691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:47 devstack sudo[89353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_t6648956devstack@QuobyteHD Apr 15 20:12:47 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:47 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:12:47 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:47 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-14ed2da7-40bf-40f1-b14f-2009c4424a06 tempest-VolumesCloneTest-902691462 None] Acquiring lock "cinder-7d13e5bf-6b66-4678-b710-b07863675614-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:12:47 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-14ed2da7-40bf-40f1-b14f-2009c4424a06 tempest-VolumesCloneTest-902691462 None] Lock "cinder-7d13e5bf-6b66-4678-b710-b07863675614-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:12:48 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-14ed2da7-40bf-40f1-b14f-2009c4424a06 tempest-VolumesCloneTest-902691462 None] Acquiring lock "cinder-quobyte-7d13e5bf-6b66-4678-b710-b07863675614" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:12:48 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-14ed2da7-40bf-40f1-b14f-2009c4424a06 tempest-VolumesCloneTest-902691462 None] Lock "cinder-quobyte-7d13e5bf-6b66-4678-b710-b07863675614" acquired by "delete_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:12:48 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[3290f84e-d267-4ffa-82dc-8b138835dc69]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-14ed2da7-40bf-40f1-b14f-2009c4424a06 tempest-VolumesCloneTest-902691462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:48 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614 Apr 15 20:12:48 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:48 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5c516629-54fc-4e30-bfb6-a6fc53a6f133 tempest-VolumesCloneTest-902691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.433s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:48 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-5c516629-54fc-4e30-bfb6-a6fc53a6f133 tempest-VolumesCloneTest-902691462 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:12:48 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-5c516629-54fc-4e30-bfb6-a6fc53a6f133 tempest-VolumesCloneTest-902691462 None] Deleted volume successfully. Apr 15 20:12:48 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5c516629-54fc-4e30-bfb6-a6fc53a6f133 tempest-VolumesCloneTest-902691462 None] Lock "cinder-c2eee10f-2f42-49ba-8a6c-98c98cbadee2-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:12:48 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_t6648956devstack@QuobyteHD" returned: 0 in 0.517s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:48 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] c89b049d-8e9b-40a2-9350-466dd874c3a8 was qcow2, converting to raw {{(pid=82989) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 20:12:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_t6648956devstack@QuobyteHD /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:48 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_t6648956devstack@QuobyteHD /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 Apr 15 20:12:48 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:48 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-14ed2da7-40bf-40f1-b14f-2009c4424a06 tempest-VolumesCloneTest-902691462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614" returned: 0 in 0.477s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-14ed2da7-40bf-40f1-b14f-2009c4424a06 tempest-VolumesCloneTest-902691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:48 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614 Apr 15 20:12:48 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:48 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-14ed2da7-40bf-40f1-b14f-2009c4424a06 tempest-VolumesCloneTest-902691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7d13e5bf-6b66-4678-b710-b07863675614" returned: 0 in 0.433s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:48 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-14ed2da7-40bf-40f1-b14f-2009c4424a06 tempest-VolumesCloneTest-902691462 None] Lock "cinder-quobyte-7d13e5bf-6b66-4678-b710-b07863675614" released by "delete_volume" :: held 0.946s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:12:48 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-14ed2da7-40bf-40f1-b14f-2009c4424a06 tempest-VolumesCloneTest-902691462 None] Created reservations ['3636452a-0ae2-485e-9a2d-e533a2ed60e9', '48863586-38a1-4e65-bb47-b255a8e43bb4', '3ac77c39-bb49-45fd-97fb-28abb68ec61a', '9acda319-6b07-4464-8d84-9c7b8ca2f6a7'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:12:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-14ed2da7-40bf-40f1-b14f-2009c4424a06 tempest-VolumesCloneTest-902691462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-14ed2da7-40bf-40f1-b14f-2009c4424a06 tempest-VolumesCloneTest-902691462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:49 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-14ed2da7-40bf-40f1-b14f-2009c4424a06 tempest-VolumesCloneTest-902691462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:12:49 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-14ed2da7-40bf-40f1-b14f-2009c4424a06 tempest-VolumesCloneTest-902691462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:12:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-14ed2da7-40bf-40f1-b14f-2009c4424a06 tempest-VolumesCloneTest-902691462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-14ed2da7-40bf-40f1-b14f-2009c4424a06 tempest-VolumesCloneTest-902691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:49 devstack sudo[89385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:12:49 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:49 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_t6648956devstack@QuobyteHD /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053" returned: 0 in 0.898s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:49 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c89b049d-8e9b-40a2-9350-466dd874c3a8_t6648956devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 {{(pid=82989) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 20:12:49 devstack cinder-volume[82989]: INFO cinder.image.image_utils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Converted 112.00 MB image at 112.00 MB/s Apr 15 20:12:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:49 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 1G Apr 15 20:12:49 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:49 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-14ed2da7-40bf-40f1-b14f-2009c4424a06 tempest-VolumesCloneTest-902691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.510s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:49 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-14ed2da7-40bf-40f1-b14f-2009c4424a06 tempest-VolumesCloneTest-902691462 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:12:49 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-14ed2da7-40bf-40f1-b14f-2009c4424a06 tempest-VolumesCloneTest-902691462 None] Deleted volume successfully. Apr 15 20:12:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-14ed2da7-40bf-40f1-b14f-2009c4424a06 tempest-VolumesCloneTest-902691462 None] Lock "cinder-7d13e5bf-6b66-4678-b710-b07863675614-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:12:49 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 1G" returned: 0 in 0.471s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:49 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[d420bad0-fc72-4558-b47b-5ff6887f68e8]: (4, 'raw') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:49 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 Apr 15 20:12:49 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:50 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053" returned: 0 in 0.500s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:50 devstack sudo[89397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 Apr 15 20:12:50 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:50 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053" returned: 1 in 0.500s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053' failed. Not Retrying. {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 20:12:50 devstack cinder-volume[82989]: DEBUG cinder.volume.volume_utils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Downloaded image c89b049d-8e9b-40a2-9350-466dd874c3a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}])) to volume 0d3e5226-d8f0-44a2-a589-2576047cc053 successfully. {{(pid=82989) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 20:12:50 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Temporary image c89b049d-8e9b-40a2-9350-466dd874c3a8 for user 8688edce03c24f79a55cd4802f927984 is deleted. {{(pid=82989) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 20:12:50 devstack cinder-volume[82989]: DEBUG cinder.volume.volume_utils [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Marking volume 0d3e5226-d8f0-44a2-a589-2576047cc053 as bootable. {{(pid=82989) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 20:12:50 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Copying metadata from image c89b049d-8e9b-40a2-9350-466dd874c3a8 to 0d3e5226-d8f0-44a2-a589-2576047cc053. {{(pid=82989) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 20:12:50 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Creating volume glance metadata for volume 0d3e5226-d8f0-44a2-a589-2576047cc053 backed by image c89b049d-8e9b-40a2-9350-466dd874c3a8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82989) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 20:12:50 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9842a45-6bca-448a-890f-3a425c4484e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d3e5226-d8f0-44a2-a589-2576047cc053', 'volume_size': 1, 'image_id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c89b049d-8e9b-40a2-9350-466dd874c3a8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f111d55abd084743b16b1c60d303fb2b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c89b049d-8e9b-40a2-9350-466dd874c3a8', 'created_at': datetime.datetime(2026, 4, 15, 18, 0, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 18, 0, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c89b049d-8e9b-40a2-9350-466dd874c3a8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:50 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7afed01-2b08-4eb5-9cb2-6be460aca81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:50 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Volume volume-0d3e5226-d8f0-44a2-a589-2576047cc053 (0d3e5226-d8f0-44a2-a589-2576047cc053): created successfully Apr 15 20:12:50 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7afed01-2b08-4eb5-9cb2-6be460aca81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:50 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Flow 'volume_create_manager' (d4748855-6cec-4afb-ba46-b5aad84f47b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:12:50 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-e88c61ec-172f-4d69-b792-d02ff4b0e93e tempest-VolumesExtendTest-1953616057 None] Created volume successfully. Apr 15 20:12:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-bfbc41be-36e0-4269-8f09-7f79c29bfcec tempest-VolumesExtendTest-1953616057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-bfbc41be-36e0-4269-8f09-7f79c29bfcec tempest-VolumesExtendTest-1953616057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:51 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[75df948e-11ca-42e5-9a2b-9c76f8993e94]: (4, 'raw') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bfbc41be-36e0-4269-8f09-7f79c29bfcec tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:51 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 Apr 15 20:12:51 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:51 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bfbc41be-36e0-4269-8f09-7f79c29bfcec tempest-VolumesExtendTest-1953616057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053" returned: 0 in 0.522s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bfbc41be-36e0-4269-8f09-7f79c29bfcec tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:51 devstack sudo[89406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 Apr 15 20:12:51 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:52 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bfbc41be-36e0-4269-8f09-7f79c29bfcec tempest-VolumesExtendTest-1953616057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053" returned: 1 in 0.523s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bfbc41be-36e0-4269-8f09-7f79c29bfcec tempest-VolumesExtendTest-1953616057 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053' failed. Not Retrying. {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 20:12:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bfbc41be-36e0-4269-8f09-7f79c29bfcec tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 2G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bfbc41be-36e0-4269-8f09-7f79c29bfcec tempest-VolumesExtendTest-1953616057 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 2G" returned: 0 in 0.049s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-bfbc41be-36e0-4269-8f09-7f79c29bfcec tempest-VolumesExtendTest-1953616057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.130s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:52 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-bfbc41be-36e0-4269-8f09-7f79c29bfcec tempest-VolumesExtendTest-1953616057 None] Extend volume completed successfully. Apr 15 20:12:53 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a8209b97-f420-4315-9cf9-712dc94b72e6 tempest-VolumesExtendTest-1953616057 None] Acquiring lock "cinder-0d3e5226-d8f0-44a2-a589-2576047cc053-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:12:53 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a8209b97-f420-4315-9cf9-712dc94b72e6 tempest-VolumesExtendTest-1953616057 None] Lock "cinder-0d3e5226-d8f0-44a2-a589-2576047cc053-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:12:53 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a8209b97-f420-4315-9cf9-712dc94b72e6 tempest-VolumesExtendTest-1953616057 None] Acquiring lock "cinder-quobyte-0d3e5226-d8f0-44a2-a589-2576047cc053" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:12:53 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a8209b97-f420-4315-9cf9-712dc94b72e6 tempest-VolumesExtendTest-1953616057 None] Lock "cinder-quobyte-0d3e5226-d8f0-44a2-a589-2576047cc053" acquired by "delete_volume" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:12:53 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc107e74-7cd6-42cd-b9c6-1253cfb35ca9]: (4, 'raw') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a8209b97-f420-4315-9cf9-712dc94b72e6 tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:53 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 Apr 15 20:12:53 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:53 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a8209b97-f420-4315-9cf9-712dc94b72e6 tempest-VolumesExtendTest-1953616057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053" returned: 0 in 0.529s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a8209b97-f420-4315-9cf9-712dc94b72e6 tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:54 devstack sudo[89419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 Apr 15 20:12:54 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:54 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a8209b97-f420-4315-9cf9-712dc94b72e6 tempest-VolumesExtendTest-1953616057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053" returned: 1 in 0.551s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a8209b97-f420-4315-9cf9-712dc94b72e6 tempest-VolumesExtendTest-1953616057 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053' failed. Not Retrying. {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 20:12:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a8209b97-f420-4315-9cf9-712dc94b72e6 tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:54 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053 Apr 15 20:12:54 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:54 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a8209b97-f420-4315-9cf9-712dc94b72e6 tempest-VolumesExtendTest-1953616057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0d3e5226-d8f0-44a2-a589-2576047cc053" returned: 0 in 0.481s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:54 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a8209b97-f420-4315-9cf9-712dc94b72e6 tempest-VolumesExtendTest-1953616057 None] Lock "cinder-quobyte-0d3e5226-d8f0-44a2-a589-2576047cc053" released by "delete_volume" :: held 1.603s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-a8209b97-f420-4315-9cf9-712dc94b72e6 tempest-VolumesExtendTest-1953616057 None] Created reservations ['94ba3486-563d-4793-a9f1-b5a80a40740c', '72fbf3eb-7fc6-4fa7-8525-2a30522abe76', 'e2ddea9b-e11e-4f11-8388-31f454b6d389', 'e2914080-5ea2-44d6-91bd-e953ec698d94'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a8209b97-f420-4315-9cf9-712dc94b72e6 tempest-VolumesExtendTest-1953616057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a8209b97-f420-4315-9cf9-712dc94b72e6 tempest-VolumesExtendTest-1953616057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-a8209b97-f420-4315-9cf9-712dc94b72e6 tempest-VolumesExtendTest-1953616057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-a8209b97-f420-4315-9cf9-712dc94b72e6 tempest-VolumesExtendTest-1953616057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a8209b97-f420-4315-9cf9-712dc94b72e6 tempest-VolumesExtendTest-1953616057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a8209b97-f420-4315-9cf9-712dc94b72e6 tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:55 devstack sudo[89427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:12:55 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:55 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a8209b97-f420-4315-9cf9-712dc94b72e6 tempest-VolumesExtendTest-1953616057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.453s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-a8209b97-f420-4315-9cf9-712dc94b72e6 tempest-VolumesExtendTest-1953616057 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:12:55 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-a8209b97-f420-4315-9cf9-712dc94b72e6 tempest-VolumesExtendTest-1953616057 None] Deleted volume successfully. Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a8209b97-f420-4315-9cf9-712dc94b72e6 tempest-VolumesExtendTest-1953616057 None] Lock "cinder-0d3e5226-d8f0-44a2-a589-2576047cc053-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Flow 'volume_create_manager' (f978091c-74ab-4e34-9d7c-351fe9dffc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee06368e-37ef-4edc-ae0b-a8243efb702a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee06368e-37ef-4edc-ae0b-a8243efb702a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1952181178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cde7138-093a-4099-a6ce-c81ed249504a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='926f8f9f4c474711a0a6366e4ef654d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:56Z,use_quota=True,user_id='8688edce03c24f79a55cd4802f927984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (201fb72b-06a3-4f32-9451-89363420d4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (201fb72b-06a3-4f32-9451-89363420d4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc360bf1-0183-4808-a6c8-245913d4093c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc360bf1-0183-4808-a6c8-245913d4093c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cde7138-093a-4099-a6ce-c81ed249504a', 'volume_name': 'volume-5cde7138-093a-4099-a6ce-c81ed249504a', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e07d9c5-8632-4313-a94f-51ff22e4fe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e07d9c5-8632-4313-a94f-51ff22e4fe8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f45a47-74aa-4e09-90b0-24621c6a29d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:55 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Volume 5cde7138-093a-4099-a6ce-c81ed249504a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cde7138-093a-4099-a6ce-c81ed249504a', 'volume_size': 1} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1952181178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cde7138-093a-4099-a6ce-c81ed249504a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='926f8f9f4c474711a0a6366e4ef654d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:56Z,use_quota=True,user_id='8688edce03c24f79a55cd4802f927984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Creating volume 5cde7138-093a-4099-a6ce-c81ed249504a {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:12:55 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:12:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:55 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a 1073741824 Apr 15 20:12:55 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:56 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a 1073741824" returned: 0 in 0.548s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:56 devstack sudo[89436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a Apr 15 20:12:56 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:56 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a" returned: 0 in 0.465s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:56 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:12:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f45a47-74aa-4e09-90b0-24621c6a29d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cde7138-093a-4099-a6ce-c81ed249504a', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (715b1f02-b4d3-47b1-84a2-a81acfe78818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:56 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Volume volume-5cde7138-093a-4099-a6ce-c81ed249504a (5cde7138-093a-4099-a6ce-c81ed249504a): created successfully Apr 15 20:12:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (715b1f02-b4d3-47b1-84a2-a81acfe78818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Flow 'volume_create_manager' (f978091c-74ab-4e34-9d7c-351fe9dffc91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:12:56 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-4623fe6b-6aa4-4d17-b974-27fbb5e46983 tempest-VolumesExtendTest-1953616057 None] Created volume successfully. Apr 15 20:12:57 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:12:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Flow 'volume_create_manager' (708e30dd-f098-4393-8f4a-a031c4295dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:12:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18ea1fa2-6106-485d-a4db-e47f0ad3299b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18ea1fa2-6106-485d-a4db-e47f0ad3299b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-502551570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b710358-4dfd-4fb2-adb9-6b315b941c68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70d4f2fe0ed4fecbcf13bdd50752c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:58Z,use_quota=True,user_id='bf8f3efc1427484cb69a89802315918d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000e6a6b-e8e0-4587-b54a-65980a1df125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000e6a6b-e8e0-4587-b54a-65980a1df125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4084c5-b41e-4260-b941-71db3e598d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4084c5-b41e-4260-b941-71db3e598d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b710358-4dfd-4fb2-adb9-6b315b941c68', 'volume_name': 'volume-2b710358-4dfd-4fb2-adb9-6b315b941c68', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bfaedae-5334-4d17-a0ac-dca033c425c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bfaedae-5334-4d17-a0ac-dca033c425c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:57 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd9b71a-beff-4c0b-b21b-92b9cf2bf87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:57 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Volume 2b710358-4dfd-4fb2-adb9-6b315b941c68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b710358-4dfd-4fb2-adb9-6b315b941c68', 'volume_size': 1} Apr 15 20:12:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:57 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-502551570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b710358-4dfd-4fb2-adb9-6b315b941c68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70d4f2fe0ed4fecbcf13bdd50752c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:12:58Z,use_quota=True,user_id='bf8f3efc1427484cb69a89802315918d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:12:57 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Creating volume 2b710358-4dfd-4fb2-adb9-6b315b941c68 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:12:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:57 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:12:57 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:12:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:57 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:12:57 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:12:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:57 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68 1073741824 Apr 15 20:12:57 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c679500d-6e50-4ec2-afaa-1859330f11ba tempest-VolumesExtendTest-1953616057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:12:58 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68 1073741824" returned: 0 in 0.465s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:58 devstack sudo[89444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68 Apr 15 20:12:58 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:58 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68" returned: 0 in 0.406s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:58 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:12:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:12:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c679500d-6e50-4ec2-afaa-1859330f11ba tempest-VolumesExtendTest-1953616057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.734s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:12:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd9b71a-beff-4c0b-b21b-92b9cf2bf87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b710358-4dfd-4fb2-adb9-6b315b941c68', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c2449d6-acbd-464d-98c3-71d0513e1ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:12:58 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-c679500d-6e50-4ec2-afaa-1859330f11ba tempest-VolumesExtendTest-1953616057 None] Creating offline snapshot 521df6b7-7253-4d98-a4c4-ca92cf32429a of volume 5cde7138-093a-4099-a6ce-c81ed249504a {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:12:58 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Volume volume-2b710358-4dfd-4fb2-adb9-6b315b941c68 (2b710358-4dfd-4fb2-adb9-6b315b941c68): created successfully Apr 15 20:12:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c2449d6-acbd-464d-98c3-71d0513e1ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:12:58 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Flow 'volume_create_manager' (708e30dd-f098-4393-8f4a-a031c4295dcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:12:58 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[8499356f-69a4-4851-bb36-43ab77d1088b]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:12:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c679500d-6e50-4ec2-afaa-1859330f11ba tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:58 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-1fa7ca79-1787-48b8-af54-66edfbf94452 tempest-VolumesSnapshotTestJSON-1226514416 None] Created volume successfully. Apr 15 20:12:58 devstack sudo[89447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a Apr 15 20:12:58 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:59 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c679500d-6e50-4ec2-afaa-1859330f11ba tempest-VolumesExtendTest-1953616057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a" returned: 0 in 0.457s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c679500d-6e50-4ec2-afaa-1859330f11ba tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.521df6b7-7253-4d98-a4c4-ca92cf32429a 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:59 devstack sudo[89452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.521df6b7-7253-4d98-a4c4-ca92cf32429a 1G Apr 15 20:12:59 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:12:59 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root Apr 15 20:12:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c679500d-6e50-4ec2-afaa-1859330f11ba tempest-VolumesExtendTest-1953616057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.521df6b7-7253-4d98-a4c4-ca92cf32429a 1G" returned: 0 in 0.458s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:12:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c679500d-6e50-4ec2-afaa-1859330f11ba tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cde7138-093a-4099-a6ce-c81ed249504a -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.521df6b7-7253-4d98-a4c4-ca92cf32429a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:12:59 devstack sudo[89457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cde7138-093a-4099-a6ce-c81ed249504a -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.521df6b7-7253-4d98-a4c4-ca92cf32429a Apr 15 20:12:59 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-370fb53b-2370-4621-8bbd-c620eca7331c tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:00 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c679500d-6e50-4ec2-afaa-1859330f11ba tempest-VolumesExtendTest-1953616057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cde7138-093a-4099-a6ce-c81ed249504a -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.521df6b7-7253-4d98-a4c4-ca92cf32429a" returned: 0 in 0.480s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:00 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-c679500d-6e50-4ec2-afaa-1859330f11ba tempest-VolumesExtendTest-1953616057 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.521df6b7-7253-4d98-a4c4-ca92cf32429a is being set with open permissions: ugo+rw Apr 15 20:13:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c679500d-6e50-4ec2-afaa-1859330f11ba tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.521df6b7-7253-4d98-a4c4-ca92cf32429a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:00 devstack sudo[89462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.521df6b7-7253-4d98-a4c4-ca92cf32429a Apr 15 20:13:00 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:00 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c679500d-6e50-4ec2-afaa-1859330f11ba tempest-VolumesExtendTest-1953616057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.521df6b7-7253-4d98-a4c4-ca92cf32429a" returned: 0 in 0.396s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c679500d-6e50-4ec2-afaa-1859330f11ba tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:00 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.info Apr 15 20:13:00 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:00 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c679500d-6e50-4ec2-afaa-1859330f11ba tempest-VolumesExtendTest-1953616057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.info" returned: 0 in 0.391s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:00 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-c679500d-6e50-4ec2-afaa-1859330f11ba tempest-VolumesExtendTest-1953616057 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.info is being set with open permissions: ugo+rw Apr 15 20:13:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c679500d-6e50-4ec2-afaa-1859330f11ba tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:00 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.info Apr 15 20:13:00 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:01 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c679500d-6e50-4ec2-afaa-1859330f11ba tempest-VolumesExtendTest-1953616057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.info" returned: 0 in 0.391s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c679500d-6e50-4ec2-afaa-1859330f11ba tempest-VolumesExtendTest-1953616057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.652s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-370fb53b-2370-4621-8bbd-c620eca7331c tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.311s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:01 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-370fb53b-2370-4621-8bbd-c620eca7331c tempest-VolumesSnapshotTestJSON-1226514416 None] Creating offline snapshot 3888b82e-8552-42f9-a0c6-c8f93f50a1bc of volume 2b710358-4dfd-4fb2-adb9-6b315b941c68 {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:13:01 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[465ef656-9add-4c43-a796-6f571833d281]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-370fb53b-2370-4621-8bbd-c620eca7331c tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:01 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-c679500d-6e50-4ec2-afaa-1859330f11ba tempest-VolumesExtendTest-1953616057 None] Create snapshot completed successfully Apr 15 20:13:01 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68 Apr 15 20:13:01 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:01 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-370fb53b-2370-4621-8bbd-c620eca7331c tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68" returned: 0 in 0.447s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-370fb53b-2370-4621-8bbd-c620eca7331c tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.3888b82e-8552-42f9-a0c6-c8f93f50a1bc 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:01 devstack sudo[89482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.3888b82e-8552-42f9-a0c6-c8f93f50a1bc 1G Apr 15 20:13:01 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3b5ac5ca-d7b7-4a94-a4bb-97c8b92af3fc tempest-VolumesExtendTest-1953616057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:02 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-370fb53b-2370-4621-8bbd-c620eca7331c tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.3888b82e-8552-42f9-a0c6-c8f93f50a1bc 1G" returned: 0 in 0.475s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-370fb53b-2370-4621-8bbd-c620eca7331c tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b710358-4dfd-4fb2-adb9-6b315b941c68 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.3888b82e-8552-42f9-a0c6-c8f93f50a1bc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:02 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b710358-4dfd-4fb2-adb9-6b315b941c68 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.3888b82e-8552-42f9-a0c6-c8f93f50a1bc Apr 15 20:13:02 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:02 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-370fb53b-2370-4621-8bbd-c620eca7331c tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b710358-4dfd-4fb2-adb9-6b315b941c68 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.3888b82e-8552-42f9-a0c6-c8f93f50a1bc" returned: 0 in 0.440s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:02 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-370fb53b-2370-4621-8bbd-c620eca7331c tempest-VolumesSnapshotTestJSON-1226514416 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.3888b82e-8552-42f9-a0c6-c8f93f50a1bc is being set with open permissions: ugo+rw Apr 15 20:13:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-370fb53b-2370-4621-8bbd-c620eca7331c tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.3888b82e-8552-42f9-a0c6-c8f93f50a1bc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:02 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.3888b82e-8552-42f9-a0c6-c8f93f50a1bc Apr 15 20:13:02 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:03 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-370fb53b-2370-4621-8bbd-c620eca7331c tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.3888b82e-8552-42f9-a0c6-c8f93f50a1bc" returned: 0 in 0.451s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-370fb53b-2370-4621-8bbd-c620eca7331c tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:03 devstack sudo[89496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.info Apr 15 20:13:03 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:03 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-370fb53b-2370-4621-8bbd-c620eca7331c tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.info" returned: 0 in 0.467s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:03 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-370fb53b-2370-4621-8bbd-c620eca7331c tempest-VolumesSnapshotTestJSON-1226514416 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.info is being set with open permissions: ugo+rw Apr 15 20:13:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-370fb53b-2370-4621-8bbd-c620eca7331c tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:03 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.info Apr 15 20:13:03 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:04 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-370fb53b-2370-4621-8bbd-c620eca7331c tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.info" returned: 0 in 0.407s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-370fb53b-2370-4621-8bbd-c620eca7331c tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.752s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3b5ac5ca-d7b7-4a94-a4bb-97c8b92af3fc tempest-VolumesExtendTest-1953616057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.951s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:04 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f7fbbf-86e6-4726-a6cd-ff0a4a1797c8]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3b5ac5ca-d7b7-4a94-a4bb-97c8b92af3fc tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:04 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-370fb53b-2370-4621-8bbd-c620eca7331c tempest-VolumesSnapshotTestJSON-1226514416 None] Create snapshot completed successfully Apr 15 20:13:04 devstack sudo[89502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a Apr 15 20:13:04 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:04 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3b5ac5ca-d7b7-4a94-a4bb-97c8b92af3fc tempest-VolumesExtendTest-1953616057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a" returned: 0 in 0.508s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3b5ac5ca-d7b7-4a94-a4bb-97c8b92af3fc tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.521df6b7-7253-4d98-a4c4-ca92cf32429a 2G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3b5ac5ca-d7b7-4a94-a4bb-97c8b92af3fc tempest-VolumesExtendTest-1953616057 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.521df6b7-7253-4d98-a4c4-ca92cf32429a 2G" returned: 0 in 0.053s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3b5ac5ca-d7b7-4a94-a4bb-97c8b92af3fc tempest-VolumesExtendTest-1953616057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.580s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:04 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-3b5ac5ca-d7b7-4a94-a4bb-97c8b92af3fc tempest-VolumesExtendTest-1953616057 None] Extend volume completed successfully. Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b22f339c-2263-4e88-b087-ea7d418c1eab tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "cinder-3888b82e-8552-42f9-a0c6-c8f93f50a1bc-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b22f339c-2263-4e88-b087-ea7d418c1eab tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-3888b82e-8552-42f9-a0c6-c8f93f50a1bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b22f339c-2263-4e88-b087-ea7d418c1eab tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "cinder-quobyte-2b710358-4dfd-4fb2-adb9-6b315b941c68" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b22f339c-2263-4e88-b087-ea7d418c1eab tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-2b710358-4dfd-4fb2-adb9-6b315b941c68" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b22f339c-2263-4e88-b087-ea7d418c1eab tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "cinder-quobyte-3888b82e-8552-42f9-a0c6-c8f93f50a1bc" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b22f339c-2263-4e88-b087-ea7d418c1eab tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-3888b82e-8552-42f9-a0c6-c8f93f50a1bc" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-b22f339c-2263-4e88-b087-ea7d418c1eab tempest-VolumesSnapshotTestJSON-1226514416 None] Deleting offline snapshot 3888b82e-8552-42f9-a0c6-c8f93f50a1bc of volume 2b710358-4dfd-4fb2-adb9-6b315b941c68 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-b22f339c-2263-4e88-b087-ea7d418c1eab tempest-VolumesSnapshotTestJSON-1226514416 None] snapshot_file for this snap is: volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.3888b82e-8552-42f9-a0c6-c8f93f50a1bc {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a09442-7b4c-4dc4-bfb8-caa5c7dd8539]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b22f339c-2263-4e88-b087-ea7d418c1eab tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.3888b82e-8552-42f9-a0c6-c8f93f50a1bc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:05 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.3888b82e-8552-42f9-a0c6-c8f93f50a1bc Apr 15 20:13:05 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e714e146-2bf7-4ebe-9a87-0b29314a4a81 tempest-VolumesExtendTest-1953616057 None] Acquiring lock "cinder-521df6b7-7253-4d98-a4c4-ca92cf32429a-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e714e146-2bf7-4ebe-9a87-0b29314a4a81 tempest-VolumesExtendTest-1953616057 None] Lock "cinder-521df6b7-7253-4d98-a4c4-ca92cf32429a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e714e146-2bf7-4ebe-9a87-0b29314a4a81 tempest-VolumesExtendTest-1953616057 None] Acquiring lock "cinder-quobyte-5cde7138-093a-4099-a6ce-c81ed249504a" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e714e146-2bf7-4ebe-9a87-0b29314a4a81 tempest-VolumesExtendTest-1953616057 None] Lock "cinder-quobyte-5cde7138-093a-4099-a6ce-c81ed249504a" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e714e146-2bf7-4ebe-9a87-0b29314a4a81 tempest-VolumesExtendTest-1953616057 None] Acquiring lock "cinder-quobyte-521df6b7-7253-4d98-a4c4-ca92cf32429a" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e714e146-2bf7-4ebe-9a87-0b29314a4a81 tempest-VolumesExtendTest-1953616057 None] Lock "cinder-quobyte-521df6b7-7253-4d98-a4c4-ca92cf32429a" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-e714e146-2bf7-4ebe-9a87-0b29314a4a81 tempest-VolumesExtendTest-1953616057 None] Deleting offline snapshot 521df6b7-7253-4d98-a4c4-ca92cf32429a of volume 5cde7138-093a-4099-a6ce-c81ed249504a {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-e714e146-2bf7-4ebe-9a87-0b29314a4a81 tempest-VolumesExtendTest-1953616057 None] snapshot_file for this snap is: volume-5cde7138-093a-4099-a6ce-c81ed249504a.521df6b7-7253-4d98-a4c4-ca92cf32429a {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd1bcf6-1585-40e0-a732-13280ed27ece]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e714e146-2bf7-4ebe-9a87-0b29314a4a81 tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.521df6b7-7253-4d98-a4c4-ca92cf32429a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:05 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.521df6b7-7253-4d98-a4c4-ca92cf32429a Apr 15 20:13:05 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:05 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b22f339c-2263-4e88-b087-ea7d418c1eab tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.3888b82e-8552-42f9-a0c6-c8f93f50a1bc" returned: 0 in 0.476s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-b22f339c-2263-4e88-b087-ea7d418c1eab tempest-VolumesSnapshotTestJSON-1226514416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b710358-4dfd-4fb2-adb9-6b315b941c68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d5dabe-7afe-498e-b251-2390458141bd]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b22f339c-2263-4e88-b087-ea7d418c1eab tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:05 devstack sudo[89517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68 Apr 15 20:13:05 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:06 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e714e146-2bf7-4ebe-9a87-0b29314a4a81 tempest-VolumesExtendTest-1953616057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.521df6b7-7253-4d98-a4c4-ca92cf32429a" returned: 0 in 0.505s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:06 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-e714e146-2bf7-4ebe-9a87-0b29314a4a81 tempest-VolumesExtendTest-1953616057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cde7138-093a-4099-a6ce-c81ed249504a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:13:06 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddf7011-1f87-46b3-ae1b-7bec6e6ebe24]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e714e146-2bf7-4ebe-9a87-0b29314a4a81 tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:06 devstack sudo[89522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a Apr 15 20:13:06 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:06 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b22f339c-2263-4e88-b087-ea7d418c1eab tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68" returned: 0 in 0.444s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b22f339c-2263-4e88-b087-ea7d418c1eab tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.3888b82e-8552-42f9-a0c6-c8f93f50a1bc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:06 devstack sudo[89527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.3888b82e-8552-42f9-a0c6-c8f93f50a1bc Apr 15 20:13:06 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:06 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e714e146-2bf7-4ebe-9a87-0b29314a4a81 tempest-VolumesExtendTest-1953616057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a" returned: 0 in 0.483s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e714e146-2bf7-4ebe-9a87-0b29314a4a81 tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.521df6b7-7253-4d98-a4c4-ca92cf32429a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:06 devstack sudo[89532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.521df6b7-7253-4d98-a4c4-ca92cf32429a Apr 15 20:13:06 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:06 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b22f339c-2263-4e88-b087-ea7d418c1eab tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.3888b82e-8552-42f9-a0c6-c8f93f50a1bc" returned: 0 in 0.471s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b22f339c-2263-4e88-b087-ea7d418c1eab tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.3888b82e-8552-42f9-a0c6-c8f93f50a1bc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:06 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.3888b82e-8552-42f9-a0c6-c8f93f50a1bc Apr 15 20:13:06 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:06 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e714e146-2bf7-4ebe-9a87-0b29314a4a81 tempest-VolumesExtendTest-1953616057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.521df6b7-7253-4d98-a4c4-ca92cf32429a" returned: 0 in 0.459s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e714e146-2bf7-4ebe-9a87-0b29314a4a81 tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.521df6b7-7253-4d98-a4c4-ca92cf32429a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:07 devstack sudo[89542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.521df6b7-7253-4d98-a4c4-ca92cf32429a Apr 15 20:13:07 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:07 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b22f339c-2263-4e88-b087-ea7d418c1eab tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68.3888b82e-8552-42f9-a0c6-c8f93f50a1bc" returned: 0 in 0.409s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b22f339c-2263-4e88-b087-ea7d418c1eab tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-3888b82e-8552-42f9-a0c6-c8f93f50a1bc" released by "_delete_snapshot" :: held 1.851s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b22f339c-2263-4e88-b087-ea7d418c1eab tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-2b710358-4dfd-4fb2-adb9-6b315b941c68" released by "delete_snapshot" :: held 1.861s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-b22f339c-2263-4e88-b087-ea7d418c1eab tempest-VolumesSnapshotTestJSON-1226514416 None] Created reservations ['0ce0cdd7-be32-4c04-8038-60404013f198', 'f753d491-b8d2-4341-b9c6-a0b57692d2c5', '1d9e1bf9-b1c1-4839-9afe-1d33fd802e4b', '031ee732-56ce-4a8a-b5b5-fc5ddf2b1b62'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:13:07 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-b22f339c-2263-4e88-b087-ea7d418c1eab tempest-VolumesSnapshotTestJSON-1226514416 None] Delete snapshot completed successfully. Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b22f339c-2263-4e88-b087-ea7d418c1eab tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-3888b82e-8552-42f9-a0c6-c8f93f50a1bc-delete_snapshot" released by "delete_snapshot" :: held 1.966s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:07 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e714e146-2bf7-4ebe-9a87-0b29314a4a81 tempest-VolumesExtendTest-1953616057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a.521df6b7-7253-4d98-a4c4-ca92cf32429a" returned: 0 in 0.445s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e714e146-2bf7-4ebe-9a87-0b29314a4a81 tempest-VolumesExtendTest-1953616057 None] Lock "cinder-quobyte-521df6b7-7253-4d98-a4c4-ca92cf32429a" released by "_delete_snapshot" :: held 1.943s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e714e146-2bf7-4ebe-9a87-0b29314a4a81 tempest-VolumesExtendTest-1953616057 None] Lock "cinder-quobyte-5cde7138-093a-4099-a6ce-c81ed249504a" released by "delete_snapshot" :: held 1.954s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-e714e146-2bf7-4ebe-9a87-0b29314a4a81 tempest-VolumesExtendTest-1953616057 None] Created reservations ['09510e0d-ac0d-460f-9b1a-a05cc160094f', 'fed81a66-2c3e-4722-bac0-94bb9be9d30d', '684e54b0-c63f-4ccd-a550-4c5d18581dc8', '66939537-4778-4831-86cd-2a495f281121'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:13:07 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-e714e146-2bf7-4ebe-9a87-0b29314a4a81 tempest-VolumesExtendTest-1953616057 None] Delete snapshot completed successfully. Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e714e146-2bf7-4ebe-9a87-0b29314a4a81 tempest-VolumesExtendTest-1953616057 None] Lock "cinder-521df6b7-7253-4d98-a4c4-ca92cf32429a-delete_snapshot" released by "delete_snapshot" :: held 2.042s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5f2b3f47-978e-4009-b5d2-9e1755133095 tempest-VolumesExtendTest-1953616057 None] Acquiring lock "cinder-5cde7138-093a-4099-a6ce-c81ed249504a-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5f2b3f47-978e-4009-b5d2-9e1755133095 tempest-VolumesExtendTest-1953616057 None] Lock "cinder-5cde7138-093a-4099-a6ce-c81ed249504a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5f2b3f47-978e-4009-b5d2-9e1755133095 tempest-VolumesExtendTest-1953616057 None] Acquiring lock "cinder-quobyte-5cde7138-093a-4099-a6ce-c81ed249504a" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5f2b3f47-978e-4009-b5d2-9e1755133095 tempest-VolumesExtendTest-1953616057 None] Lock "cinder-quobyte-5cde7138-093a-4099-a6ce-c81ed249504a" acquired by "delete_volume" :: waited 0.012s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf16843-5b48-458e-99ac-3f6450f2ea8e]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5f2b3f47-978e-4009-b5d2-9e1755133095 tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:07 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a Apr 15 20:13:07 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Flow 'volume_create_manager' (377074d3-2880-451e-9257-fd00270a7660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd13c9c-7eea-4dc0-a11e-e0247b705d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd13c9c-7eea-4dc0-a11e-e0247b705d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-391380666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3409629d-8da0-48d7-a115-fb643da87407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70d4f2fe0ed4fecbcf13bdd50752c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:08Z,use_quota=True,user_id='bf8f3efc1427484cb69a89802315918d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dc90bb8-64a9-4771-be07-5e7a9d84a64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dc90bb8-64a9-4771-be07-5e7a9d84a64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b432fca5-da5b-43d4-8a5e-aeac67290ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b432fca5-da5b-43d4-8a5e-aeac67290ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3409629d-8da0-48d7-a115-fb643da87407', 'volume_name': 'volume-3409629d-8da0-48d7-a115-fb643da87407', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774e4982-0c04-4f78-9755-2562c6823cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774e4982-0c04-4f78-9755-2562c6823cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1120cafa-7d37-4c14-bae2-f5d4e81a9f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:07 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Volume 3409629d-8da0-48d7-a115-fb643da87407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3409629d-8da0-48d7-a115-fb643da87407', 'volume_size': 1} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-391380666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3409629d-8da0-48d7-a115-fb643da87407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70d4f2fe0ed4fecbcf13bdd50752c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:08Z,use_quota=True,user_id='bf8f3efc1427484cb69a89802315918d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Creating volume 3409629d-8da0-48d7-a115-fb643da87407 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:13:07 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:13:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:07 devstack sudo[89548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407 1073741824 Apr 15 20:13:07 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:08 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5f2b3f47-978e-4009-b5d2-9e1755133095 tempest-VolumesExtendTest-1953616057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a" returned: 0 in 0.478s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5f2b3f47-978e-4009-b5d2-9e1755133095 tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:08 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a Apr 15 20:13:08 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:08 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407 1073741824" returned: 0 in 0.496s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:08 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407 Apr 15 20:13:08 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:08 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5f2b3f47-978e-4009-b5d2-9e1755133095 tempest-VolumesExtendTest-1953616057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5cde7138-093a-4099-a6ce-c81ed249504a" returned: 0 in 0.420s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:08 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5f2b3f47-978e-4009-b5d2-9e1755133095 tempest-VolumesExtendTest-1953616057 None] Lock "cinder-quobyte-5cde7138-093a-4099-a6ce-c81ed249504a" released by "delete_volume" :: held 0.933s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:08 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-5f2b3f47-978e-4009-b5d2-9e1755133095 tempest-VolumesExtendTest-1953616057 None] Created reservations ['894b1126-4dc9-439a-8b76-32885d7d0866', '49de7b03-b5c4-44a1-82b8-58075a1580f8', 'a57d4a8b-ba15-4325-a0dc-c22f22df21a6', '381d816b-5619-46b8-abb0-b8d3a96fa44b'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:13:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5f2b3f47-978e-4009-b5d2-9e1755133095 tempest-VolumesExtendTest-1953616057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5f2b3f47-978e-4009-b5d2-9e1755133095 tempest-VolumesExtendTest-1953616057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:08 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-5f2b3f47-978e-4009-b5d2-9e1755133095 tempest-VolumesExtendTest-1953616057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:08 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-5f2b3f47-978e-4009-b5d2-9e1755133095 tempest-VolumesExtendTest-1953616057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5f2b3f47-978e-4009-b5d2-9e1755133095 tempest-VolumesExtendTest-1953616057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5f2b3f47-978e-4009-b5d2-9e1755133095 tempest-VolumesExtendTest-1953616057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:08 devstack sudo[89561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:13:08 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:08 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407" returned: 0 in 0.484s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:08 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:13:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:08 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1120cafa-7d37-4c14-bae2-f5d4e81a9f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3409629d-8da0-48d7-a115-fb643da87407', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:08 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be31bf4-49a8-4379-b315-d6a9a1c93a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:08 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Volume volume-3409629d-8da0-48d7-a115-fb643da87407 (3409629d-8da0-48d7-a115-fb643da87407): created successfully Apr 15 20:13:08 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be31bf4-49a8-4379-b315-d6a9a1c93a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:08 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Flow 'volume_create_manager' (377074d3-2880-451e-9257-fd00270a7660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:13:08 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-fae98db5-f475-4d78-aa71-0caf6c324fef tempest-VolumesSnapshotTestJSON-1226514416 None] Created volume successfully. Apr 15 20:13:09 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5f2b3f47-978e-4009-b5d2-9e1755133095 tempest-VolumesExtendTest-1953616057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.433s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:09 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-5f2b3f47-978e-4009-b5d2-9e1755133095 tempest-VolumesExtendTest-1953616057 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:13:09 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-5f2b3f47-978e-4009-b5d2-9e1755133095 tempest-VolumesExtendTest-1953616057 None] Deleted volume successfully. Apr 15 20:13:09 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5f2b3f47-978e-4009-b5d2-9e1755133095 tempest-VolumesExtendTest-1953616057 None] Lock "cinder-5cde7138-093a-4099-a6ce-c81ed249504a-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-aa7878c5-5fa7-4a7e-a94a-956d89055d11 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-aa7878c5-5fa7-4a7e-a94a-956d89055d11 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:10 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-aa7878c5-5fa7-4a7e-a94a-956d89055d11 tempest-VolumesSnapshotTestJSON-1226514416 None] Creating offline snapshot f208833e-aa9b-47c8-aa78-b4a9b1bc42c3 of volume 3409629d-8da0-48d7-a115-fb643da87407 {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:13:10 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87faa1c-9620-4329-b42d-5877040da8a4]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa7878c5-5fa7-4a7e-a94a-956d89055d11 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:10 devstack sudo[89599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407 Apr 15 20:13:10 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:10 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:13:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Flow 'volume_create_manager' (f5f9de86-5b1c-4b7b-b287-ee4396c70766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:13:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b40d5484-71a0-41a0-a67f-1d6873540654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b40d5484-71a0-41a0-a67f-1d6873540654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-790361811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=210c153e-62d8-417e-8507-ea78bbe480b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc69e67ff9f74807b40c6095be4d2311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:11Z,use_quota=True,user_id='0a246f920b0746a6a481743dbf559f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (524e4ae6-c21a-487f-baee-a69b287244b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (524e4ae6-c21a-487f-baee-a69b287244b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4311e558-3824-4a59-9ee5-3db8fb8bb5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:10 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4311e558-3824-4a59-9ee5-3db8fb8bb5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '210c153e-62d8-417e-8507-ea78bbe480b0', 'volume_name': 'volume-210c153e-62d8-417e-8507-ea78bbe480b0', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91540d61-d92a-405e-8e78-5672e995ba55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91540d61-d92a-405e-8e78-5672e995ba55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4704193-9b34-47bf-8daf-a471725f4fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:10 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Volume 210c153e-62d8-417e-8507-ea78bbe480b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-210c153e-62d8-417e-8507-ea78bbe480b0', 'volume_size': 1} Apr 15 20:13:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa7878c5-5fa7-4a7e-a94a-956d89055d11 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407" returned: 0 in 0.587s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa7878c5-5fa7-4a7e-a94a-956d89055d11 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.f208833e-aa9b-47c8-aa78-b4a9b1bc42c3 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:10 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.f208833e-aa9b-47c8-aa78-b4a9b1bc42c3 1G Apr 15 20:13:10 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:11 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa7878c5-5fa7-4a7e-a94a-956d89055d11 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.f208833e-aa9b-47c8-aa78-b4a9b1bc42c3 1G" returned: 0 in 0.529s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa7878c5-5fa7-4a7e-a94a-956d89055d11 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3409629d-8da0-48d7-a115-fb643da87407 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.f208833e-aa9b-47c8-aa78-b4a9b1bc42c3 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:11 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3409629d-8da0-48d7-a115-fb643da87407 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.f208833e-aa9b-47c8-aa78-b4a9b1bc42c3 Apr 15 20:13:11 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:11 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa7878c5-5fa7-4a7e-a94a-956d89055d11 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3409629d-8da0-48d7-a115-fb643da87407 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.f208833e-aa9b-47c8-aa78-b4a9b1bc42c3" returned: 0 in 0.444s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:11 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-aa7878c5-5fa7-4a7e-a94a-956d89055d11 tempest-VolumesSnapshotTestJSON-1226514416 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.f208833e-aa9b-47c8-aa78-b4a9b1bc42c3 is being set with open permissions: ugo+rw Apr 15 20:13:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa7878c5-5fa7-4a7e-a94a-956d89055d11 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.f208833e-aa9b-47c8-aa78-b4a9b1bc42c3 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:11 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.f208833e-aa9b-47c8-aa78-b4a9b1bc42c3 Apr 15 20:13:11 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:12 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa7878c5-5fa7-4a7e-a94a-956d89055d11 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.f208833e-aa9b-47c8-aa78-b4a9b1bc42c3" returned: 0 in 0.413s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa7878c5-5fa7-4a7e-a94a-956d89055d11 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:12 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.info Apr 15 20:13:12 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:12 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa7878c5-5fa7-4a7e-a94a-956d89055d11 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.info" returned: 0 in 0.417s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:12 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-aa7878c5-5fa7-4a7e-a94a-956d89055d11 tempest-VolumesSnapshotTestJSON-1226514416 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.info is being set with open permissions: ugo+rw Apr 15 20:13:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa7878c5-5fa7-4a7e-a94a-956d89055d11 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:12 devstack sudo[89621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.info Apr 15 20:13:12 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:12 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa7878c5-5fa7-4a7e-a94a-956d89055d11 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.info" returned: 0 in 0.449s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-aa7878c5-5fa7-4a7e-a94a-956d89055d11 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.895s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.301s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:12 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-790361811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=210c153e-62d8-417e-8507-ea78bbe480b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc69e67ff9f74807b40c6095be4d2311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:11Z,use_quota=True,user_id='0a246f920b0746a6a481743dbf559f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:13:12 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Creating volume 210c153e-62d8-417e-8507-ea78bbe480b0 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:13:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:12 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:12 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:12 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:13:12 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:13:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-210c153e-62d8-417e-8507-ea78bbe480b0 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:12 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-aa7878c5-5fa7-4a7e-a94a-956d89055d11 tempest-VolumesSnapshotTestJSON-1226514416 None] Create snapshot completed successfully Apr 15 20:13:12 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-210c153e-62d8-417e-8507-ea78bbe480b0 1073741824 Apr 15 20:13:12 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:13:13 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Flow 'volume_create_manager' (74a0fc31-500d-417d-9151-0e07b76c4796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee6d562-bd38-4f79-ad57-8c06c4275081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-210c153e-62d8-417e-8507-ea78bbe480b0 1073741824" returned: 0 in 0.519s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee6d562-bd38-4f79-ad57-8c06c4275081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-581981164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe869f3c-32d5-44e3-b543-14be9afc8f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70d4f2fe0ed4fecbcf13bdd50752c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f208833e-aa9b-47c8-aa78-b4a9b1bc42c3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:13Z,use_quota=True,user_id='bf8f3efc1427484cb69a89802315918d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40275bca-be86-4bd8-92f9-a0febc3d315d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40275bca-be86-4bd8-92f9-a0febc3d315d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5551107c-31cb-400c-9d16-50985b12fd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5551107c-31cb-400c-9d16-50985b12fd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fe869f3c-32d5-44e3-b543-14be9afc8f31', 'volume_name': 'volume-fe869f3c-32d5-44e3-b543-14be9afc8f31', 'volume_size': 2, 'snapshot_id': 'f208833e-aa9b-47c8-aa78-b4a9b1bc42c3'}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8efa1979-4014-46ea-851f-ff2c682fc906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8efa1979-4014-46ea-851f-ff2c682fc906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9bf3f3-6348-4ba0-91c1-8411afa0fc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:13 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Volume fe869f3c-32d5-44e3-b543-14be9afc8f31: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fe869f3c-32d5-44e3-b543-14be9afc8f31', 'volume_size': 2, 'snapshot_id': 'f208833e-aa9b-47c8-aa78-b4a9b1bc42c3'} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-210c153e-62d8-417e-8507-ea78bbe480b0 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:13 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-210c153e-62d8-417e-8507-ea78bbe480b0 Apr 15 20:13:13 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:13 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-210c153e-62d8-417e-8507-ea78bbe480b0" returned: 0 in 0.410s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.423s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "cinder-quobyte-f208833e-aa9b-47c8-aa78-b4a9b1bc42c3-fe869f3c-32d5-44e3-b543-14be9afc8f31" by "_create_volume_from_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4704193-9b34-47bf-8daf-a471725f4fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-210c153e-62d8-417e-8507-ea78bbe480b0', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ff8947-18e8-467f-8862-898a3f8beb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-f208833e-aa9b-47c8-aa78-b4a9b1bc42c3-fe869f3c-32d5-44e3-b543-14be9afc8f31" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Creating volume fe869f3c-32d5-44e3-b543-14be9afc8f31 from snapshot f208833e-aa9b-47c8-aa78-b4a9b1bc42c3 {{(pid=82989) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "cinder-quobyte-fe869f3c-32d5-44e3-b543-14be9afc8f31" by "_copy_volume_from_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:13 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Volume volume-210c153e-62d8-417e-8507-ea78bbe480b0 (210c153e-62d8-417e-8507-ea78bbe480b0): created successfully Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ff8947-18e8-467f-8862-898a3f8beb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Flow 'volume_create_manager' (f5f9de86-5b1c-4b7b-b287-ee4396c70766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-fe869f3c-32d5-44e3-b543-14be9afc8f31" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:13 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] snapshot: f208833e-aa9b-47c8-aa78-b4a9b1bc42c3, volume: fe869f3c-32d5-44e3-b543-14be9afc8f31, {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 20:13:13 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-1bf94da2-d76f-433b-9e69-6b483fee1b66 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Created volume successfully. Apr 15 20:13:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:14 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a1519b-ace5-4791-a11b-29928aac6f97]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.f208833e-aa9b-47c8-aa78-b4a9b1bc42c3 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:14 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.f208833e-aa9b-47c8-aa78-b4a9b1bc42c3 Apr 15 20:13:14 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:14 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.f208833e-aa9b-47c8-aa78-b4a9b1bc42c3" returned: 0 in 0.472s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3409629d-8da0-48d7-a115-fb643da87407(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:13:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407 {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 20:13:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Creating direct copy from snapshot {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 20:13:14 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed977005-e932-4587-a821-7be8298b8715]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:14 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407 Apr 15 20:13:14 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:15 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407" returned: 0 in 0.520s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.utils [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Path /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fe869f3c-32d5-44e3-b543-14be9afc8f31 not found in is_blk_device check {{(pid=82989) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fe869f3c-32d5-44e3-b543-14be9afc8f31 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:13:15 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fe869f3c-32d5-44e3-b543-14be9afc8f31 Apr 15 20:13:15 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Flow 'volume_create_manager' (fe1f2356-7944-42ee-92e9-57b1ffdfad8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd312094-ab85-4445-82cb-26ce71844bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd312094-ab85-4445-82cb-26ce71844bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-541369045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb1734e6-4efa-444c-a719-e673c3c5dfad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc69e67ff9f74807b40c6095be4d2311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:15Z,use_quota=True,user_id='0a246f920b0746a6a481743dbf559f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fbfb305-9ad6-4e51-b3a8-a56f55ed5122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fbfb305-9ad6-4e51-b3a8-a56f55ed5122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c89dfc61-a979-4e5c-80b4-938adf7b4dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c89dfc61-a979-4e5c-80b4-938adf7b4dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb1734e6-4efa-444c-a719-e673c3c5dfad', 'volume_name': 'volume-fb1734e6-4efa-444c-a719-e673c3c5dfad', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b479db90-c792-43f8-a93d-43f22ff1d15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b479db90-c792-43f8-a93d-43f22ff1d15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19410a32-260f-4f29-9a81-1d04d74be2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:15 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Volume fb1734e6-4efa-444c-a719-e673c3c5dfad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb1734e6-4efa-444c-a719-e673c3c5dfad', 'volume_size': 1} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Flow 'volume_create_manager' (3091a461-0b4c-4465-a4bd-b4a54aef6f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76552ce7-85f0-4d07-be54-f02c64a62476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76552ce7-85f0-4d07-be54-f02c64a62476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1627216619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaca5f9b-bc5f-439d-8d3e-9d68c73d087c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc69e67ff9f74807b40c6095be4d2311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:15Z,use_quota=True,user_id='0a246f920b0746a6a481743dbf559f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d397fc5c-f171-4eb1-bb03-ff436de768de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d397fc5c-f171-4eb1-bb03-ff436de768de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f10c48-6328-4a8b-ac23-9f538cd3c009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f10c48-6328-4a8b-ac23-9f538cd3c009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaca5f9b-bc5f-439d-8d3e-9d68c73d087c', 'volume_name': 'volume-eaca5f9b-bc5f-439d-8d3e-9d68c73d087c', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d416bd-7ffd-4cb5-9178-f10d4c06f7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d416bd-7ffd-4cb5-9178-f10d4c06f7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8942d549-fafd-4f79-b4a0-56dfd7f21aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:15 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Volume eaca5f9b-bc5f-439d-8d3e-9d68c73d087c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaca5f9b-bc5f-439d-8d3e-9d68c73d087c', 'volume_size': 1} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Flow 'volume_create_manager' (ea33adbc-7bb1-4960-9ba5-2e7c29bb6536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (686c6ed2-e548-4063-ace0-074103aff5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (686c6ed2-e548-4063-ace0-074103aff5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1703570537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d6966c2-2eae-4305-a372-f955cbf5c938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc69e67ff9f74807b40c6095be4d2311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:15Z,use_quota=True,user_id='0a246f920b0746a6a481743dbf559f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a65bbe-094d-4978-840c-df1a7493ff38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a65bbe-094d-4978-840c-df1a7493ff38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec7b4bf-cc63-4048-8a38-5e334dd5435e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec7b4bf-cc63-4048-8a38-5e334dd5435e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d6966c2-2eae-4305-a372-f955cbf5c938', 'volume_name': 'volume-6d6966c2-2eae-4305-a372-f955cbf5c938', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f74b1b4c-c08a-46d4-a018-854cd9ff8aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f74b1b4c-c08a-46d4-a018-854cd9ff8aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4dd4c2-b602-4578-ac45-0941eded597c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:15 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Volume 6d6966c2-2eae-4305-a372-f955cbf5c938: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d6966c2-2eae-4305-a372-f955cbf5c938', 'volume_size': 1} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Flow 'volume_create_manager' (5d4a98ae-d530-4c7c-ac14-feb409a37f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8887b49c-8c63-4a46-9bf2-01fb7b98000f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8887b49c-8c63-4a46-9bf2-01fb7b98000f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-213495752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce89858c-119c-4be5-8f22-671f8182a547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc69e67ff9f74807b40c6095be4d2311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:16Z,use_quota=True,user_id='0a246f920b0746a6a481743dbf559f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea220034-e738-411f-847c-dc13a5bbf010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea220034-e738-411f-847c-dc13a5bbf010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4268177-8843-444e-8ad8-25fb71d07494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4268177-8843-444e-8ad8-25fb71d07494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce89858c-119c-4be5-8f22-671f8182a547', 'volume_name': 'volume-ce89858c-119c-4be5-8f22-671f8182a547', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c202e07-d642-45ac-b141-c9c5b84ab993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c202e07-d642-45ac-b141-c9c5b84ab993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:16 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8b3585-43c2-45bf-af7e-8a85d103a4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:16 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Volume ce89858c-119c-4be5-8f22-671f8182a547: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce89858c-119c-4be5-8f22-671f8182a547', 'volume_size': 1} Apr 15 20:13:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:16 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:13:16 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Flow 'volume_create_manager' (6460754e-f2c3-4be4-8778-a776b83e3846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:13:16 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25c7709-18e2-4a2e-8dd4-61c63032ff35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:16 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25c7709-18e2-4a2e-8dd4-61c63032ff35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-76401963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40dcf92-a282-4e69-8a61-2120eba449f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc69e67ff9f74807b40c6095be4d2311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:17Z,use_quota=True,user_id='0a246f920b0746a6a481743dbf559f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:16 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d709f33-ee75-4e9b-9d20-09cb112e9d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:16 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d709f33-ee75-4e9b-9d20-09cb112e9d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:16 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85863928-0c7e-4222-857e-d84c6ba139e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:16 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85863928-0c7e-4222-857e-d84c6ba139e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c40dcf92-a282-4e69-8a61-2120eba449f8', 'volume_name': 'volume-c40dcf92-a282-4e69-8a61-2120eba449f8', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:16 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b76e618-99b1-4009-a40e-11c6d450128a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:16 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b76e618-99b1-4009-a40e-11c6d450128a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:16 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee63d240-0bf5-469f-b623-98ce57fcd72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:16 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Volume c40dcf92-a282-4e69-8a61-2120eba449f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c40dcf92-a282-4e69-8a61-2120eba449f8', 'volume_size': 1} Apr 15 20:13:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:17 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fe869f3c-32d5-44e3-b543-14be9afc8f31" returned: 0 in 2.065s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:17 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f684c2d-b045-46c1-91ef-22f545247fab]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:17 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407 Apr 15 20:13:17 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:17 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407" returned: 0 in 0.564s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:17 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407, size 1024.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fe869f3c-32d5-44e3-b543-14be9afc8f31 {{(pid=82989) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 20:13:17 devstack cinder-volume[82989]: INFO cinder.image.image_utils [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Converted 1024.00 MB image at 495.71 MB/s Apr 15 20:13:17 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fe869f3c-32d5-44e3-b543-14be9afc8f31 is being set with open permissions: ugo+rw Apr 15 20:13:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fe869f3c-32d5-44e3-b543-14be9afc8f31 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:17 devstack sudo[89661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fe869f3c-32d5-44e3-b543-14be9afc8f31 Apr 15 20:13:17 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:18 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fe869f3c-32d5-44e3-b543-14be9afc8f31" returned: 0 in 0.391s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-fe869f3c-32d5-44e3-b543-14be9afc8f31" released by "_copy_volume_from_snapshot" :: held 4.070s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-f208833e-aa9b-47c8-aa78-b4a9b1bc42c3-fe869f3c-32d5-44e3-b543-14be9afc8f31" released by "_create_volume_from_snapshot" :: held 4.096s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.117s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.955s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-541369045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb1734e6-4efa-444c-a719-e673c3c5dfad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc69e67ff9f74807b40c6095be4d2311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:15Z,use_quota=True,user_id='0a246f920b0746a6a481743dbf559f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Creating volume fb1734e6-4efa-444c-a719-e673c3c5dfad {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:13:18 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fb1734e6-4efa-444c-a719-e673c3c5dfad 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:18 devstack sudo[89664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fb1734e6-4efa-444c-a719-e673c3c5dfad 1073741824 Apr 15 20:13:18 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9bf3f3-6348-4ba0-91c1-8411afa0fc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe869f3c-32d5-44e3-b543-14be9afc8f31', 'volume_size': 2, 'snapshot_id': 'f208833e-aa9b-47c8-aa78-b4a9b1bc42c3'}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203b1449-8641-46ea-81be-57c6572be3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:18 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Volume volume-fe869f3c-32d5-44e3-b543-14be9afc8f31 (fe869f3c-32d5-44e3-b543-14be9afc8f31): created successfully Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203b1449-8641-46ea-81be-57c6572be3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Flow 'volume_create_manager' (74a0fc31-500d-417d-9151-0e07b76c4796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:13:18 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-cdeead3b-6b18-441e-bd43-351a6f5380b8 tempest-VolumesSnapshotTestJSON-1226514416 None] Created volume successfully. Apr 15 20:13:18 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fb1734e6-4efa-444c-a719-e673c3c5dfad 1073741824" returned: 0 in 0.458s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fb1734e6-4efa-444c-a719-e673c3c5dfad {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:18 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fb1734e6-4efa-444c-a719-e673c3c5dfad Apr 15 20:13:18 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-73e71ac9-bf5d-4941-933d-55e5d29ef4c9 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "cinder-fe869f3c-32d5-44e3-b543-14be9afc8f31-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-73e71ac9-bf5d-4941-933d-55e5d29ef4c9 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-fe869f3c-32d5-44e3-b543-14be9afc8f31-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-73e71ac9-bf5d-4941-933d-55e5d29ef4c9 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "cinder-quobyte-fe869f3c-32d5-44e3-b543-14be9afc8f31" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-73e71ac9-bf5d-4941-933d-55e5d29ef4c9 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-fe869f3c-32d5-44e3-b543-14be9afc8f31" acquired by "delete_volume" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5831596-9e3b-4c04-84c1-32a17a555a41]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-73e71ac9-bf5d-4941-933d-55e5d29ef4c9 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fe869f3c-32d5-44e3-b543-14be9afc8f31 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:18 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fe869f3c-32d5-44e3-b543-14be9afc8f31 Apr 15 20:13:18 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:18 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fb1734e6-4efa-444c-a719-e673c3c5dfad" returned: 0 in 0.418s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.653s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1627216619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaca5f9b-bc5f-439d-8d3e-9d68c73d087c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc69e67ff9f74807b40c6095be4d2311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:15Z,use_quota=True,user_id='0a246f920b0746a6a481743dbf559f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Creating volume eaca5f9b-bc5f-439d-8d3e-9d68c73d087c {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:13:18 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eaca5f9b-bc5f-439d-8d3e-9d68c73d087c 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19410a32-260f-4f29-9a81-1d04d74be2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb1734e6-4efa-444c-a719-e673c3c5dfad', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:18 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eaca5f9b-bc5f-439d-8d3e-9d68c73d087c 1073741824 Apr 15 20:13:18 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1f5cb2-0506-48d2-b04b-a7af1adf5a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:18 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:19 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Volume volume-fb1734e6-4efa-444c-a719-e673c3c5dfad (fb1734e6-4efa-444c-a719-e673c3c5dfad): created successfully Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1f5cb2-0506-48d2-b04b-a7af1adf5a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Flow 'volume_create_manager' (fe1f2356-7944-42ee-92e9-57b1ffdfad8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:13:19 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-f95ae6ae-e294-4c50-abcd-054414c81556 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Created volume successfully. Apr 15 20:13:19 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-73e71ac9-bf5d-4941-933d-55e5d29ef4c9 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fe869f3c-32d5-44e3-b543-14be9afc8f31" returned: 0 in 0.484s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-73e71ac9-bf5d-4941-933d-55e5d29ef4c9 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fe869f3c-32d5-44e3-b543-14be9afc8f31 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:19 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fe869f3c-32d5-44e3-b543-14be9afc8f31 Apr 15 20:13:19 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:19 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eaca5f9b-bc5f-439d-8d3e-9d68c73d087c 1073741824" returned: 0 in 0.473s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eaca5f9b-bc5f-439d-8d3e-9d68c73d087c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:19 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eaca5f9b-bc5f-439d-8d3e-9d68c73d087c Apr 15 20:13:19 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:19 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-73e71ac9-bf5d-4941-933d-55e5d29ef4c9 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fe869f3c-32d5-44e3-b543-14be9afc8f31" returned: 0 in 0.410s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-73e71ac9-bf5d-4941-933d-55e5d29ef4c9 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-fe869f3c-32d5-44e3-b543-14be9afc8f31" released by "delete_volume" :: held 0.913s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-73e71ac9-bf5d-4941-933d-55e5d29ef4c9 tempest-VolumesSnapshotTestJSON-1226514416 None] Created reservations ['fd4df764-40c8-4d73-b0bb-4fbbbd701113', '55844d53-1d81-441b-b6b1-f81b5d5a62d8', 'b52bb3d1-d8d3-452b-a52e-6a5e22c042f1', '60c6ef0b-c942-4def-8381-6e3d949afae8'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-73e71ac9-bf5d-4941-933d-55e5d29ef4c9 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-73e71ac9-bf5d-4941-933d-55e5d29ef4c9 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-73e71ac9-bf5d-4941-933d-55e5d29ef4c9 tempest-VolumesSnapshotTestJSON-1226514416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-73e71ac9-bf5d-4941-933d-55e5d29ef4c9 tempest-VolumesSnapshotTestJSON-1226514416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-73e71ac9-bf5d-4941-933d-55e5d29ef4c9 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-73e71ac9-bf5d-4941-933d-55e5d29ef4c9 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:19 devstack sudo[89688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:13:19 devstack sudo[89688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:19 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eaca5f9b-bc5f-439d-8d3e-9d68c73d087c" returned: 0 in 0.433s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.307s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1703570537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d6966c2-2eae-4305-a372-f955cbf5c938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc69e67ff9f74807b40c6095be4d2311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:15Z,use_quota=True,user_id='0a246f920b0746a6a481743dbf559f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Creating volume 6d6966c2-2eae-4305-a372-f955cbf5c938 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:13:19 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6d6966c2-2eae-4305-a372-f955cbf5c938 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:19 devstack sudo[89690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6d6966c2-2eae-4305-a372-f955cbf5c938 1073741824 Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8942d549-fafd-4f79-b4a0-56dfd7f21aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaca5f9b-bc5f-439d-8d3e-9d68c73d087c', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:19 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c62ccbb-8104-4f46-ad67-a826dd309d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:19 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Volume volume-eaca5f9b-bc5f-439d-8d3e-9d68c73d087c (eaca5f9b-bc5f-439d-8d3e-9d68c73d087c): created successfully Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c62ccbb-8104-4f46-ad67-a826dd309d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Flow 'volume_create_manager' (3091a461-0b4c-4465-a4bd-b4a54aef6f6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:13:19 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-5786b73d-d67e-40a6-a712-58b80226fb58 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Created volume successfully. Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-024504bc-1148-46bb-8835-c8c100362b3c tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "cinder-f208833e-aa9b-47c8-aa78-b4a9b1bc42c3-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-024504bc-1148-46bb-8835-c8c100362b3c tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-f208833e-aa9b-47c8-aa78-b4a9b1bc42c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-024504bc-1148-46bb-8835-c8c100362b3c tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "cinder-quobyte-3409629d-8da0-48d7-a115-fb643da87407" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-024504bc-1148-46bb-8835-c8c100362b3c tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-3409629d-8da0-48d7-a115-fb643da87407" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:19 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-024504bc-1148-46bb-8835-c8c100362b3c tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "cinder-quobyte-f208833e-aa9b-47c8-aa78-b4a9b1bc42c3" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-024504bc-1148-46bb-8835-c8c100362b3c tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-f208833e-aa9b-47c8-aa78-b4a9b1bc42c3" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-024504bc-1148-46bb-8835-c8c100362b3c tempest-VolumesSnapshotTestJSON-1226514416 None] Deleting offline snapshot f208833e-aa9b-47c8-aa78-b4a9b1bc42c3 of volume 3409629d-8da0-48d7-a115-fb643da87407 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-024504bc-1148-46bb-8835-c8c100362b3c tempest-VolumesSnapshotTestJSON-1226514416 None] snapshot_file for this snap is: volume-3409629d-8da0-48d7-a115-fb643da87407.f208833e-aa9b-47c8-aa78-b4a9b1bc42c3 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e0803c-3b53-4b4e-8a85-f09cb5d50689]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-024504bc-1148-46bb-8835-c8c100362b3c tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.f208833e-aa9b-47c8-aa78-b4a9b1bc42c3 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:20 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.f208833e-aa9b-47c8-aa78-b4a9b1bc42c3 Apr 15 20:13:20 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:20 devstack sudo[89688]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-73e71ac9-bf5d-4941-933d-55e5d29ef4c9 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.450s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-73e71ac9-bf5d-4941-933d-55e5d29ef4c9 tempest-VolumesSnapshotTestJSON-1226514416 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:13:20 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-73e71ac9-bf5d-4941-933d-55e5d29ef4c9 tempest-VolumesSnapshotTestJSON-1226514416 None] Deleted volume successfully. Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-73e71ac9-bf5d-4941-933d-55e5d29ef4c9 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-fe869f3c-32d5-44e3-b543-14be9afc8f31-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:20 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6d6966c2-2eae-4305-a372-f955cbf5c938 1073741824" returned: 0 in 0.530s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6d6966c2-2eae-4305-a372-f955cbf5c938 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:20 devstack sudo[89701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6d6966c2-2eae-4305-a372-f955cbf5c938 Apr 15 20:13:20 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:20 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-024504bc-1148-46bb-8835-c8c100362b3c tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.f208833e-aa9b-47c8-aa78-b4a9b1bc42c3" returned: 0 in 0.486s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-024504bc-1148-46bb-8835-c8c100362b3c tempest-VolumesSnapshotTestJSON-1226514416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3409629d-8da0-48d7-a115-fb643da87407(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c4118d-c875-4f7e-ac9e-f87f2ebf017a]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-024504bc-1148-46bb-8835-c8c100362b3c tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:20 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407 Apr 15 20:13:20 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:20 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6d6966c2-2eae-4305-a372-f955cbf5c938" returned: 0 in 0.411s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.877s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-213495752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce89858c-119c-4be5-8f22-671f8182a547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc69e67ff9f74807b40c6095be4d2311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:16Z,use_quota=True,user_id='0a246f920b0746a6a481743dbf559f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Creating volume ce89858c-119c-4be5-8f22-671f8182a547 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:13:20 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ce89858c-119c-4be5-8f22-671f8182a547 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4dd4c2-b602-4578-ac45-0941eded597c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d6966c2-2eae-4305-a372-f955cbf5c938', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:20 devstack sudo[89706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ce89858c-119c-4be5-8f22-671f8182a547 1073741824 Apr 15 20:13:20 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5feb888d-dd88-48ae-a2dd-1582b9f9e6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:20 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Volume volume-6d6966c2-2eae-4305-a372-f955cbf5c938 (6d6966c2-2eae-4305-a372-f955cbf5c938): created successfully Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5feb888d-dd88-48ae-a2dd-1582b9f9e6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Flow 'volume_create_manager' (ea33adbc-7bb1-4960-9ba5-2e7c29bb6536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:13:20 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-002c3c4f-6240-4a3a-9460-0efb44f48a1f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Created volume successfully. Apr 15 20:13:20 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-024504bc-1148-46bb-8835-c8c100362b3c tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407" returned: 0 in 0.468s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-024504bc-1148-46bb-8835-c8c100362b3c tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.f208833e-aa9b-47c8-aa78-b4a9b1bc42c3 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:21 devstack sudo[89711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.f208833e-aa9b-47c8-aa78-b4a9b1bc42c3 Apr 15 20:13:21 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:21 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ce89858c-119c-4be5-8f22-671f8182a547 1073741824" returned: 0 in 0.486s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG dbcounter [-] [82989] Writing DB stats cinder:SELECT=113,cinder:INSERT=46,cinder:UPDATE=151,cinder:DELETE=9 {{(pid=82989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ce89858c-119c-4be5-8f22-671f8182a547 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:21 devstack sudo[89719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ce89858c-119c-4be5-8f22-671f8182a547 Apr 15 20:13:21 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:21 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-024504bc-1148-46bb-8835-c8c100362b3c tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.f208833e-aa9b-47c8-aa78-b4a9b1bc42c3" returned: 0 in 0.460s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-024504bc-1148-46bb-8835-c8c100362b3c tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.f208833e-aa9b-47c8-aa78-b4a9b1bc42c3 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:21 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.f208833e-aa9b-47c8-aa78-b4a9b1bc42c3 Apr 15 20:13:21 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:21 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ce89858c-119c-4be5-8f22-671f8182a547" returned: 0 in 0.404s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.881s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-76401963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40dcf92-a282-4e69-8a61-2120eba449f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc69e67ff9f74807b40c6095be4d2311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:17Z,use_quota=True,user_id='0a246f920b0746a6a481743dbf559f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Creating volume c40dcf92-a282-4e69-8a61-2120eba449f8 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:13:21 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c40dcf92-a282-4e69-8a61-2120eba449f8 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8b3585-43c2-45bf-af7e-8a85d103a4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce89858c-119c-4be5-8f22-671f8182a547', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:21 devstack sudo[89725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c40dcf92-a282-4e69-8a61-2120eba449f8 1073741824 Apr 15 20:13:21 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c8fc04-9d48-4567-bcaa-232ba258f2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:21 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:21 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Volume volume-ce89858c-119c-4be5-8f22-671f8182a547 (ce89858c-119c-4be5-8f22-671f8182a547): created successfully Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c8fc04-9d48-4567-bcaa-232ba258f2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Flow 'volume_create_manager' (5d4a98ae-d530-4c7c-ac14-feb409a37f02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-024504bc-1148-46bb-8835-c8c100362b3c tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407.f208833e-aa9b-47c8-aa78-b4a9b1bc42c3" returned: 0 in 0.442s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:21 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-aa399694-6396-4906-9f59-ef21c7f39b22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Created volume successfully. Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-024504bc-1148-46bb-8835-c8c100362b3c tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-f208833e-aa9b-47c8-aa78-b4a9b1bc42c3" released by "_delete_snapshot" :: held 1.906s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-024504bc-1148-46bb-8835-c8c100362b3c tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-3409629d-8da0-48d7-a115-fb643da87407" released by "delete_snapshot" :: held 1.921s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-024504bc-1148-46bb-8835-c8c100362b3c tempest-VolumesSnapshotTestJSON-1226514416 None] Created reservations ['1b3ee820-4f59-4f30-acbe-8c2bfda03005', '633be89c-6242-4f8b-932d-4d410034de07', '5ed37ae8-4311-44c4-b040-0409468cecd9', '29c253fb-ef90-4a2b-9a14-feabfc70ade7'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:13:21 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-024504bc-1148-46bb-8835-c8c100362b3c tempest-VolumesSnapshotTestJSON-1226514416 None] Delete snapshot completed successfully. Apr 15 20:13:21 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-024504bc-1148-46bb-8835-c8c100362b3c tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-f208833e-aa9b-47c8-aa78-b4a9b1bc42c3-delete_snapshot" released by "delete_snapshot" :: held 2.004s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1d5f535c-5e7e-4dec-ac4a-fddf500c9aa3 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "cinder-3409629d-8da0-48d7-a115-fb643da87407-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1d5f535c-5e7e-4dec-ac4a-fddf500c9aa3 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-3409629d-8da0-48d7-a115-fb643da87407-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1d5f535c-5e7e-4dec-ac4a-fddf500c9aa3 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "cinder-quobyte-3409629d-8da0-48d7-a115-fb643da87407" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1d5f535c-5e7e-4dec-ac4a-fddf500c9aa3 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-3409629d-8da0-48d7-a115-fb643da87407" acquired by "delete_volume" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:22 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf59c6d-299c-4a87-baf9-e69d447cdb7b]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1d5f535c-5e7e-4dec-ac4a-fddf500c9aa3 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:22 devstack sudo[89729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407 Apr 15 20:13:22 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:22 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c40dcf92-a282-4e69-8a61-2120eba449f8 1073741824" returned: 0 in 0.503s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c40dcf92-a282-4e69-8a61-2120eba449f8 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:22 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c40dcf92-a282-4e69-8a61-2120eba449f8 Apr 15 20:13:22 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:22 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1d5f535c-5e7e-4dec-ac4a-fddf500c9aa3 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407" returned: 0 in 0.491s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1d5f535c-5e7e-4dec-ac4a-fddf500c9aa3 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:22 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407 Apr 15 20:13:22 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:22 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c40dcf92-a282-4e69-8a61-2120eba449f8" returned: 0 in 0.412s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:22 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:13:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee63d240-0bf5-469f-b623-98ce57fcd72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c40dcf92-a282-4e69-8a61-2120eba449f8', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55af331-2589-47e2-b33e-45c7b2b650a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:22 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Volume volume-c40dcf92-a282-4e69-8a61-2120eba449f8 (c40dcf92-a282-4e69-8a61-2120eba449f8): created successfully Apr 15 20:13:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55af331-2589-47e2-b33e-45c7b2b650a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Flow 'volume_create_manager' (6460754e-f2c3-4be4-8778-a776b83e3846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:13:22 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-e8040504-63ba-437d-9427-062e403009b7 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Created volume successfully. Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2a2391dc-12a7-49cf-8597-98385d95335b tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "cinder-c40dcf92-a282-4e69-8a61-2120eba449f8-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2a2391dc-12a7-49cf-8597-98385d95335b tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-c40dcf92-a282-4e69-8a61-2120eba449f8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2a2391dc-12a7-49cf-8597-98385d95335b tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "cinder-quobyte-c40dcf92-a282-4e69-8a61-2120eba449f8" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:23 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1d5f535c-5e7e-4dec-ac4a-fddf500c9aa3 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-3409629d-8da0-48d7-a115-fb643da87407" returned: 0 in 0.444s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1d5f535c-5e7e-4dec-ac4a-fddf500c9aa3 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-3409629d-8da0-48d7-a115-fb643da87407" released by "delete_volume" :: held 0.963s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2a2391dc-12a7-49cf-8597-98385d95335b tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-quobyte-c40dcf92-a282-4e69-8a61-2120eba449f8" acquired by "delete_volume" :: waited 0.026s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42ea031-bbc8-4ff2-a347-8a4c74ba7297]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2a2391dc-12a7-49cf-8597-98385d95335b tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c40dcf92-a282-4e69-8a61-2120eba449f8 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-1d5f535c-5e7e-4dec-ac4a-fddf500c9aa3 tempest-VolumesSnapshotTestJSON-1226514416 None] Created reservations ['42dea4dd-15ec-4c69-a530-1770e5251413', '5ac8fec7-dcf7-48bf-8ab9-3e112da91c0d', '34ef7bdc-c0c9-4ff6-ae42-5e19ab16638d', 'fba30ab6-660f-42d8-8811-a6cec84cbd58'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:13:23 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c40dcf92-a282-4e69-8a61-2120eba449f8 Apr 15 20:13:23 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1d5f535c-5e7e-4dec-ac4a-fddf500c9aa3 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1d5f535c-5e7e-4dec-ac4a-fddf500c9aa3 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1d5f535c-5e7e-4dec-ac4a-fddf500c9aa3 tempest-VolumesSnapshotTestJSON-1226514416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1d5f535c-5e7e-4dec-ac4a-fddf500c9aa3 tempest-VolumesSnapshotTestJSON-1226514416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1d5f535c-5e7e-4dec-ac4a-fddf500c9aa3 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1d5f535c-5e7e-4dec-ac4a-fddf500c9aa3 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:23 devstack sudo[89744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:13:23 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Flow 'volume_create_manager' (d26211be-216b-493b-8f90-643d3ff21e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d1db79-57e9-4db6-8441-d60718cb7fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d1db79-57e9-4db6-8441-d60718cb7fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1695504221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70d4f2fe0ed4fecbcf13bdd50752c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:24Z,use_quota=True,user_id='bf8f3efc1427484cb69a89802315918d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70809531-a608-430d-90d5-0899ff6540ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70809531-a608-430d-90d5-0899ff6540ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227e1fe8-a02a-4e77-a676-a6476b238a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227e1fe8-a02a-4e77-a676-a6476b238a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3', 'volume_name': 'volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6d96a4-8a6a-45bb-82cc-eaaa29f83379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6d96a4-8a6a-45bb-82cc-eaaa29f83379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c750e61-1da2-4ba3-9655-9ce66484e039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:23 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Volume fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3', 'volume_size': 1} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1695504221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70d4f2fe0ed4fecbcf13bdd50752c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:24Z,use_quota=True,user_id='bf8f3efc1427484cb69a89802315918d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Creating volume fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:13:23 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:23 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 1073741824 Apr 15 20:13:23 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:23 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1d5f535c-5e7e-4dec-ac4a-fddf500c9aa3 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.430s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-1d5f535c-5e7e-4dec-ac4a-fddf500c9aa3 tempest-VolumesSnapshotTestJSON-1226514416 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:13:23 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-1d5f535c-5e7e-4dec-ac4a-fddf500c9aa3 tempest-VolumesSnapshotTestJSON-1226514416 None] Deleted volume successfully. Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1d5f535c-5e7e-4dec-ac4a-fddf500c9aa3 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-3409629d-8da0-48d7-a115-fb643da87407-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:23 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2a2391dc-12a7-49cf-8597-98385d95335b tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c40dcf92-a282-4e69-8a61-2120eba449f8" returned: 0 in 0.566s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2a2391dc-12a7-49cf-8597-98385d95335b tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c40dcf92-a282-4e69-8a61-2120eba449f8 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:23 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c40dcf92-a282-4e69-8a61-2120eba449f8 Apr 15 20:13:23 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:24 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 1073741824" returned: 0 in 0.465s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:24 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2a2391dc-12a7-49cf-8597-98385d95335b tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c40dcf92-a282-4e69-8a61-2120eba449f8" returned: 0 in 0.410s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:24 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2a2391dc-12a7-49cf-8597-98385d95335b tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-quobyte-c40dcf92-a282-4e69-8a61-2120eba449f8" released by "delete_volume" :: held 1.012s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:24 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 Apr 15 20:13:24 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:24 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-2a2391dc-12a7-49cf-8597-98385d95335b tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Created reservations ['c7c5324a-20a0-4c56-95d6-3e35946f9faa', '4e19a919-74d1-4e13-9693-12460978b514', 'be8b36bc-d010-42c6-800f-874e58171d32', 'cf92ded0-d895-4d6e-b095-90b85b339f6c'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:13:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2a2391dc-12a7-49cf-8597-98385d95335b tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2a2391dc-12a7-49cf-8597-98385d95335b tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:24 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2a2391dc-12a7-49cf-8597-98385d95335b tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:24 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2a2391dc-12a7-49cf-8597-98385d95335b tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2a2391dc-12a7-49cf-8597-98385d95335b tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2a2391dc-12a7-49cf-8597-98385d95335b tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:24 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:13:24 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:24 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3" returned: 0 in 0.427s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:24 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:13:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:24 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c750e61-1da2-4ba3-9655-9ce66484e039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:24 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14752ddc-a097-440f-a332-7b96ad13123c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:24 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Volume volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 (fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3): created successfully Apr 15 20:13:24 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14752ddc-a097-440f-a332-7b96ad13123c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:24 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Flow 'volume_create_manager' (d26211be-216b-493b-8f90-643d3ff21e58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:13:24 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-731b22f5-edb0-4c33-9c89-f0864d887143 tempest-VolumesSnapshotTestJSON-1226514416 None] Created volume successfully. Apr 15 20:13:24 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2a2391dc-12a7-49cf-8597-98385d95335b tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.500s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:24 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-2a2391dc-12a7-49cf-8597-98385d95335b tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:13:24 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-2a2391dc-12a7-49cf-8597-98385d95335b tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Deleted volume successfully. Apr 15 20:13:24 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2a2391dc-12a7-49cf-8597-98385d95335b tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-c40dcf92-a282-4e69-8a61-2120eba449f8-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2abb1fc5-1f06-454e-aa0c-302455acbb25 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "cinder-ce89858c-119c-4be5-8f22-671f8182a547-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2abb1fc5-1f06-454e-aa0c-302455acbb25 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-ce89858c-119c-4be5-8f22-671f8182a547-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2abb1fc5-1f06-454e-aa0c-302455acbb25 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "cinder-quobyte-ce89858c-119c-4be5-8f22-671f8182a547" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2abb1fc5-1f06-454e-aa0c-302455acbb25 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-quobyte-ce89858c-119c-4be5-8f22-671f8182a547" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:25 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[041d9fbb-e8e3-4c45-b0bf-ee2d68c80845]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2abb1fc5-1f06-454e-aa0c-302455acbb25 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ce89858c-119c-4be5-8f22-671f8182a547 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:25 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ce89858c-119c-4be5-8f22-671f8182a547 Apr 15 20:13:25 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ea9f3e1e-15a5-4afb-a245-c3503b74fbdc tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ea9f3e1e-15a5-4afb-a245-c3503b74fbdc tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:25 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-ea9f3e1e-15a5-4afb-a245-c3503b74fbdc tempest-VolumesSnapshotTestJSON-1226514416 None] Creating offline snapshot 97f48699-cf7b-4d30-ab11-3ae668dd4870 of volume fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:13:25 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0168334-2aba-425b-8d50-77d6d1bed0ad]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ea9f3e1e-15a5-4afb-a245-c3503b74fbdc tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:25 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2abb1fc5-1f06-454e-aa0c-302455acbb25 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ce89858c-119c-4be5-8f22-671f8182a547" returned: 0 in 0.516s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2abb1fc5-1f06-454e-aa0c-302455acbb25 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ce89858c-119c-4be5-8f22-671f8182a547 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:25 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ce89858c-119c-4be5-8f22-671f8182a547 Apr 15 20:13:25 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:25 devstack sudo[89769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 Apr 15 20:13:25 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:26 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ea9f3e1e-15a5-4afb-a245-c3503b74fbdc tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3" returned: 0 in 0.474s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ea9f3e1e-15a5-4afb-a245-c3503b74fbdc tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.97f48699-cf7b-4d30-ab11-3ae668dd4870 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:26 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:26 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.97f48699-cf7b-4d30-ab11-3ae668dd4870 1G Apr 15 20:13:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2abb1fc5-1f06-454e-aa0c-302455acbb25 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ce89858c-119c-4be5-8f22-671f8182a547" returned: 0 in 0.457s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:26 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:26 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2abb1fc5-1f06-454e-aa0c-302455acbb25 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-quobyte-ce89858c-119c-4be5-8f22-671f8182a547" released by "delete_volume" :: held 0.996s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:26 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-2abb1fc5-1f06-454e-aa0c-302455acbb25 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Created reservations ['b0c44cc0-fcee-4526-9cf0-976bfb43ce95', 'da1298ce-fcf6-4f3e-b98f-90df715ce03f', 'a6cdb2e4-d7dc-44ab-8629-7132bcebc3a5', '5ef30a38-020a-49f0-8369-b8c19f4c203c'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:13:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2abb1fc5-1f06-454e-aa0c-302455acbb25 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2abb1fc5-1f06-454e-aa0c-302455acbb25 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:26 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2abb1fc5-1f06-454e-aa0c-302455acbb25 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:26 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2abb1fc5-1f06-454e-aa0c-302455acbb25 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2abb1fc5-1f06-454e-aa0c-302455acbb25 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2abb1fc5-1f06-454e-aa0c-302455acbb25 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:26 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:13:26 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:26 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ea9f3e1e-15a5-4afb-a245-c3503b74fbdc tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.97f48699-cf7b-4d30-ab11-3ae668dd4870 1G" returned: 0 in 0.523s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ea9f3e1e-15a5-4afb-a245-c3503b74fbdc tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.97f48699-cf7b-4d30-ab11-3ae668dd4870 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:26 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2abb1fc5-1f06-454e-aa0c-302455acbb25 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.441s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:26 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-2abb1fc5-1f06-454e-aa0c-302455acbb25 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:13:26 devstack sudo[89785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.97f48699-cf7b-4d30-ab11-3ae668dd4870 Apr 15 20:13:26 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:26 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-2abb1fc5-1f06-454e-aa0c-302455acbb25 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Deleted volume successfully. Apr 15 20:13:26 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-2abb1fc5-1f06-454e-aa0c-302455acbb25 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-ce89858c-119c-4be5-8f22-671f8182a547-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:27 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ea9f3e1e-15a5-4afb-a245-c3503b74fbdc tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.97f48699-cf7b-4d30-ab11-3ae668dd4870" returned: 0 in 0.455s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:27 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-ea9f3e1e-15a5-4afb-a245-c3503b74fbdc tempest-VolumesSnapshotTestJSON-1226514416 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.97f48699-cf7b-4d30-ab11-3ae668dd4870 is being set with open permissions: ugo+rw Apr 15 20:13:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ea9f3e1e-15a5-4afb-a245-c3503b74fbdc tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.97f48699-cf7b-4d30-ab11-3ae668dd4870 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:27 devstack sudo[89790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.97f48699-cf7b-4d30-ab11-3ae668dd4870 Apr 15 20:13:27 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ee9290b3-c896-43bf-b293-db95f9ca0d22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "cinder-6d6966c2-2eae-4305-a372-f955cbf5c938-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ee9290b3-c896-43bf-b293-db95f9ca0d22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-6d6966c2-2eae-4305-a372-f955cbf5c938-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ee9290b3-c896-43bf-b293-db95f9ca0d22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "cinder-quobyte-6d6966c2-2eae-4305-a372-f955cbf5c938" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ee9290b3-c896-43bf-b293-db95f9ca0d22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-quobyte-6d6966c2-2eae-4305-a372-f955cbf5c938" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:27 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bfd08b-c572-4fec-9848-1be6f2b08ce6]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ee9290b3-c896-43bf-b293-db95f9ca0d22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6d6966c2-2eae-4305-a372-f955cbf5c938 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:27 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6d6966c2-2eae-4305-a372-f955cbf5c938 Apr 15 20:13:27 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:27 devstack cinder-volume[82989]: DEBUG oslo_service.periodic_task [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82989) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 20:13:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:27 devstack sudo[89795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:13:27 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:27 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ea9f3e1e-15a5-4afb-a245-c3503b74fbdc tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.97f48699-cf7b-4d30-ab11-3ae668dd4870" returned: 0 in 0.425s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ea9f3e1e-15a5-4afb-a245-c3503b74fbdc tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:27 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.info Apr 15 20:13:27 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:27 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ee9290b3-c896-43bf-b293-db95f9ca0d22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6d6966c2-2eae-4305-a372-f955cbf5c938" returned: 0 in 0.486s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ee9290b3-c896-43bf-b293-db95f9ca0d22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6d6966c2-2eae-4305-a372-f955cbf5c938 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:28 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6d6966c2-2eae-4305-a372-f955cbf5c938 Apr 15 20:13:28 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:28 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.446s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:13:28 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ea9f3e1e-15a5-4afb-a245-c3503b74fbdc tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.info" returned: 0 in 0.447s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:28 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-ea9f3e1e-15a5-4afb-a245-c3503b74fbdc tempest-VolumesSnapshotTestJSON-1226514416 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.info is being set with open permissions: ugo+rw Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ea9f3e1e-15a5-4afb-a245-c3503b74fbdc tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:28 devstack sudo[89806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.info Apr 15 20:13:28 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:28 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ee9290b3-c896-43bf-b293-db95f9ca0d22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-6d6966c2-2eae-4305-a372-f955cbf5c938" returned: 0 in 0.427s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ee9290b3-c896-43bf-b293-db95f9ca0d22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-quobyte-6d6966c2-2eae-4305-a372-f955cbf5c938" released by "delete_volume" :: held 0.938s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-ee9290b3-c896-43bf-b293-db95f9ca0d22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Created reservations ['548c4af1-f68b-4876-977f-8653ec73aa91', '00f9e87e-228e-4a3f-b434-e4a96a3f3c4f', '6bf9bbfc-1a20-456a-8e43-a3a6fea98a42', 'a77ad309-63e7-444e-8bec-022bfde42fb3'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ee9290b3-c896-43bf-b293-db95f9ca0d22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ee9290b3-c896-43bf-b293-db95f9ca0d22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ee9290b3-c896-43bf-b293-db95f9ca0d22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ee9290b3-c896-43bf-b293-db95f9ca0d22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ee9290b3-c896-43bf-b293-db95f9ca0d22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ee9290b3-c896-43bf-b293-db95f9ca0d22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:28 devstack sudo[89810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:13:28 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3ef9872b-b56c-4403-a6ed-8de5473d878e tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "cinder-eaca5f9b-bc5f-439d-8d3e-9d68c73d087c-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3ef9872b-b56c-4403-a6ed-8de5473d878e tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-eaca5f9b-bc5f-439d-8d3e-9d68c73d087c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:28 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ea9f3e1e-15a5-4afb-a245-c3503b74fbdc tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.info" returned: 0 in 0.427s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ea9f3e1e-15a5-4afb-a245-c3503b74fbdc tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.814s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:28 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-ea9f3e1e-15a5-4afb-a245-c3503b74fbdc tempest-VolumesSnapshotTestJSON-1226514416 None] Create snapshot completed successfully Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3ef9872b-b56c-4403-a6ed-8de5473d878e tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "cinder-quobyte-eaca5f9b-bc5f-439d-8d3e-9d68c73d087c" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3ef9872b-b56c-4403-a6ed-8de5473d878e tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-quobyte-eaca5f9b-bc5f-439d-8d3e-9d68c73d087c" acquired by "delete_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dec0fa3-b01a-4caf-8a0a-203ed73ff006]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3ef9872b-b56c-4403-a6ed-8de5473d878e tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eaca5f9b-bc5f-439d-8d3e-9d68c73d087c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:28 devstack sudo[89812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eaca5f9b-bc5f-439d-8d3e-9d68c73d087c Apr 15 20:13:28 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:28 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ee9290b3-c896-43bf-b293-db95f9ca0d22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.411s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-ee9290b3-c896-43bf-b293-db95f9ca0d22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:13:28 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-ee9290b3-c896-43bf-b293-db95f9ca0d22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Deleted volume successfully. Apr 15 20:13:28 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ee9290b3-c896-43bf-b293-db95f9ca0d22 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-6d6966c2-2eae-4305-a372-f955cbf5c938-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:13:29 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Flow 'volume_create_manager' (7422532d-190c-4eaf-9d21-fd3b433dbdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5254ee9-f95c-4407-95fe-34a5a4bb0f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5254ee9-f95c-4407-95fe-34a5a4bb0f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-270460676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae2b1f9-053d-4b5c-80ed-ae244c85e6df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70d4f2fe0ed4fecbcf13bdd50752c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=97f48699-cf7b-4d30-ab11-3ae668dd4870,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:29Z,use_quota=True,user_id='bf8f3efc1427484cb69a89802315918d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a267803-1cc9-4d31-aba6-c4e270b227dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a267803-1cc9-4d31-aba6-c4e270b227dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48baddb6-360e-40a6-88c6-cdfc7af85e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48baddb6-360e-40a6-88c6-cdfc7af85e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cae2b1f9-053d-4b5c-80ed-ae244c85e6df', 'volume_name': 'volume-cae2b1f9-053d-4b5c-80ed-ae244c85e6df', 'volume_size': 1, 'snapshot_id': '97f48699-cf7b-4d30-ab11-3ae668dd4870'}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc24604-f765-4522-aaab-eaa4115030dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc24604-f765-4522-aaab-eaa4115030dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4268603d-74a4-4be7-af14-d13bb114b947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:29 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Volume cae2b1f9-053d-4b5c-80ed-ae244c85e6df: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cae2b1f9-053d-4b5c-80ed-ae244c85e6df', 'volume_size': 1, 'snapshot_id': '97f48699-cf7b-4d30-ab11-3ae668dd4870'} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3ef9872b-b56c-4403-a6ed-8de5473d878e tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eaca5f9b-bc5f-439d-8d3e-9d68c73d087c" returned: 0 in 0.561s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3ef9872b-b56c-4403-a6ed-8de5473d878e tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eaca5f9b-bc5f-439d-8d3e-9d68c73d087c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "cinder-quobyte-97f48699-cf7b-4d30-ab11-3ae668dd4870-cae2b1f9-053d-4b5c-80ed-ae244c85e6df" by "_create_volume_from_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:29 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eaca5f9b-bc5f-439d-8d3e-9d68c73d087c Apr 15 20:13:29 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-97f48699-cf7b-4d30-ab11-3ae668dd4870-cae2b1f9-053d-4b5c-80ed-ae244c85e6df" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Creating volume cae2b1f9-053d-4b5c-80ed-ae244c85e6df from snapshot 97f48699-cf7b-4d30-ab11-3ae668dd4870 {{(pid=82989) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "cinder-quobyte-cae2b1f9-053d-4b5c-80ed-ae244c85e6df" by "_copy_volume_from_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-cae2b1f9-053d-4b5c-80ed-ae244c85e6df" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] snapshot: 97f48699-cf7b-4d30-ab11-3ae668dd4870, volume: cae2b1f9-053d-4b5c-80ed-ae244c85e6df, {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ee84ce-9650-447d-be33-065ba27899c3]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.97f48699-cf7b-4d30-ab11-3ae668dd4870 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:29 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.97f48699-cf7b-4d30-ab11-3ae668dd4870 Apr 15 20:13:29 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:29 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3ef9872b-b56c-4403-a6ed-8de5473d878e tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eaca5f9b-bc5f-439d-8d3e-9d68c73d087c" returned: 0 in 0.395s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3ef9872b-b56c-4403-a6ed-8de5473d878e tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-quobyte-eaca5f9b-bc5f-439d-8d3e-9d68c73d087c" released by "delete_volume" :: held 0.974s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-3ef9872b-b56c-4403-a6ed-8de5473d878e tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Created reservations ['4fd3b567-9bb7-49de-97cb-3a8e385fd489', 'dde8f014-aa0b-43b4-bf7f-e8b2357ffadc', '50d3a617-08e5-47c4-b213-aa93df435a97', '6fa639f8-7a11-41b2-8533-d013f548ef26'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3ef9872b-b56c-4403-a6ed-8de5473d878e tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3ef9872b-b56c-4403-a6ed-8de5473d878e tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3ef9872b-b56c-4403-a6ed-8de5473d878e tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3ef9872b-b56c-4403-a6ed-8de5473d878e tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3ef9872b-b56c-4403-a6ed-8de5473d878e tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3ef9872b-b56c-4403-a6ed-8de5473d878e tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:29 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:13:29 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:29 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.97f48699-cf7b-4d30-ab11-3ae668dd4870" returned: 0 in 0.474s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Creating direct copy from snapshot {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[04acac60-7146-4e86-8eab-bc207f044a7c]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:29 devstack sudo[89828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 Apr 15 20:13:29 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:30 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3ef9872b-b56c-4403-a6ed-8de5473d878e tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.394s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:30 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-3ef9872b-b56c-4403-a6ed-8de5473d878e tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:13:30 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-3ef9872b-b56c-4403-a6ed-8de5473d878e tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Deleted volume successfully. Apr 15 20:13:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3ef9872b-b56c-4403-a6ed-8de5473d878e tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-eaca5f9b-bc5f-439d-8d3e-9d68c73d087c-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:30 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3" returned: 0 in 0.461s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:30 devstack cinder-volume[82989]: DEBUG cinder.utils [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Path /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cae2b1f9-053d-4b5c-80ed-ae244c85e6df not found in is_blk_device check {{(pid=82989) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 20:13:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cae2b1f9-053d-4b5c-80ed-ae244c85e6df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:30 devstack sudo[89834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cae2b1f9-053d-4b5c-80ed-ae244c85e6df Apr 15 20:13:30 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-338e511f-2ff8-41d8-b5b8-5311187821b0 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "cinder-fb1734e6-4efa-444c-a719-e673c3c5dfad-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-338e511f-2ff8-41d8-b5b8-5311187821b0 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-fb1734e6-4efa-444c-a719-e673c3c5dfad-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:31 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-338e511f-2ff8-41d8-b5b8-5311187821b0 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "cinder-quobyte-fb1734e6-4efa-444c-a719-e673c3c5dfad" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:31 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-338e511f-2ff8-41d8-b5b8-5311187821b0 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-quobyte-fb1734e6-4efa-444c-a719-e673c3c5dfad" acquired by "delete_volume" :: waited 0.049s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:31 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a024d11-1814-49d8-b9d0-3737d8c9d25a]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-338e511f-2ff8-41d8-b5b8-5311187821b0 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fb1734e6-4efa-444c-a719-e673c3c5dfad {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:31 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fb1734e6-4efa-444c-a719-e673c3c5dfad Apr 15 20:13:31 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:32 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cae2b1f9-053d-4b5c-80ed-ae244c85e6df" returned: 0 in 2.018s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:32 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:32 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[def56187-5901-4063-9860-5f774916f4cb]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-338e511f-2ff8-41d8-b5b8-5311187821b0 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fb1734e6-4efa-444c-a719-e673c3c5dfad" returned: 0 in 1.134s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-338e511f-2ff8-41d8-b5b8-5311187821b0 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fb1734e6-4efa-444c-a719-e673c3c5dfad {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:32 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fb1734e6-4efa-444c-a719-e673c3c5dfad Apr 15 20:13:32 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:32 devstack sudo[89853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 Apr 15 20:13:32 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:32 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-338e511f-2ff8-41d8-b5b8-5311187821b0 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fb1734e6-4efa-444c-a719-e673c3c5dfad" returned: 0 in 0.408s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-338e511f-2ff8-41d8-b5b8-5311187821b0 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-quobyte-fb1734e6-4efa-444c-a719-e673c3c5dfad" released by "delete_volume" :: held 1.593s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:32 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-338e511f-2ff8-41d8-b5b8-5311187821b0 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Created reservations ['fdfb4c18-8859-42c4-848d-e5db52cdc7b3', '52be1db8-4577-4a01-9714-1bc15d1d573f', 'd286c96f-675e-4968-84f0-b0ea01a41543', 'df305374-2408-4a4e-9301-5eacfb436917'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:13:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-338e511f-2ff8-41d8-b5b8-5311187821b0 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-338e511f-2ff8-41d8-b5b8-5311187821b0 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:32 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-338e511f-2ff8-41d8-b5b8-5311187821b0 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:32 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-338e511f-2ff8-41d8-b5b8-5311187821b0 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-338e511f-2ff8-41d8-b5b8-5311187821b0 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-338e511f-2ff8-41d8-b5b8-5311187821b0 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:32 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:13:32 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:32 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3" returned: 0 in 0.644s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:32 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3, size 1024.00 MB, duration 2.02 sec, destination /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cae2b1f9-053d-4b5c-80ed-ae244c85e6df {{(pid=82989) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 20:13:32 devstack cinder-volume[82989]: INFO cinder.image.image_utils [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Converted 1024.00 MB image at 506.90 MB/s Apr 15 20:13:32 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cae2b1f9-053d-4b5c-80ed-ae244c85e6df is being set with open permissions: ugo+rw Apr 15 20:13:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cae2b1f9-053d-4b5c-80ed-ae244c85e6df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:32 devstack sudo[89863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cae2b1f9-053d-4b5c-80ed-ae244c85e6df Apr 15 20:13:32 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ae0c60e1-0893-4760-818e-6db70862a24f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "cinder-210c153e-62d8-417e-8507-ea78bbe480b0-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ae0c60e1-0893-4760-818e-6db70862a24f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-210c153e-62d8-417e-8507-ea78bbe480b0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ae0c60e1-0893-4760-818e-6db70862a24f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "cinder-quobyte-210c153e-62d8-417e-8507-ea78bbe480b0" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ae0c60e1-0893-4760-818e-6db70862a24f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-quobyte-210c153e-62d8-417e-8507-ea78bbe480b0" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:33 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fe46df-da18-4f11-8fc5-add121a20197]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ae0c60e1-0893-4760-818e-6db70862a24f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-210c153e-62d8-417e-8507-ea78bbe480b0 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:33 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-338e511f-2ff8-41d8-b5b8-5311187821b0 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.446s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:33 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-338e511f-2ff8-41d8-b5b8-5311187821b0 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:13:33 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-338e511f-2ff8-41d8-b5b8-5311187821b0 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Deleted volume successfully. Apr 15 20:13:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-338e511f-2ff8-41d8-b5b8-5311187821b0 tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-fb1734e6-4efa-444c-a719-e673c3c5dfad-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:33 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-210c153e-62d8-417e-8507-ea78bbe480b0 Apr 15 20:13:33 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:33 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cae2b1f9-053d-4b5c-80ed-ae244c85e6df" returned: 0 in 0.454s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-cae2b1f9-053d-4b5c-80ed-ae244c85e6df" released by "_copy_volume_from_snapshot" :: held 4.103s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-97f48699-cf7b-4d30-ab11-3ae668dd4870-cae2b1f9-053d-4b5c-80ed-ae244c85e6df" released by "_create_volume_from_snapshot" :: held 4.116s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.125s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:33 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4268603d-74a4-4be7-af14-d13bb114b947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cae2b1f9-053d-4b5c-80ed-ae244c85e6df', 'volume_size': 1, 'snapshot_id': '97f48699-cf7b-4d30-ab11-3ae668dd4870'}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:33 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fa7b82f-000b-4a1b-9b90-e2069f933d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:33 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Volume volume-cae2b1f9-053d-4b5c-80ed-ae244c85e6df (cae2b1f9-053d-4b5c-80ed-ae244c85e6df): created successfully Apr 15 20:13:33 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fa7b82f-000b-4a1b-9b90-e2069f933d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:33 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Flow 'volume_create_manager' (7422532d-190c-4eaf-9d21-fd3b433dbdd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:13:33 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-aa5972c3-9894-471e-8db6-f4739b9d135a tempest-VolumesSnapshotTestJSON-1226514416 None] Created volume successfully. Apr 15 20:13:33 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ae0c60e1-0893-4760-818e-6db70862a24f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-210c153e-62d8-417e-8507-ea78bbe480b0" returned: 0 in 0.499s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ae0c60e1-0893-4760-818e-6db70862a24f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-210c153e-62d8-417e-8507-ea78bbe480b0 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:33 devstack sudo[89872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-210c153e-62d8-417e-8507-ea78bbe480b0 Apr 15 20:13:33 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:34 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ae0c60e1-0893-4760-818e-6db70862a24f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-210c153e-62d8-417e-8507-ea78bbe480b0" returned: 0 in 0.393s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:34 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ae0c60e1-0893-4760-818e-6db70862a24f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-quobyte-210c153e-62d8-417e-8507-ea78bbe480b0" released by "delete_volume" :: held 0.931s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:34 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-ae0c60e1-0893-4760-818e-6db70862a24f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Created reservations ['cf83fa4c-e79f-42af-8914-3495e9c6ef0c', 'bb8839ee-55d7-4205-a065-a1d9cbe95df2', '29eb8546-84bf-4917-9b98-5ddacb1183a6', '0cc4b228-c927-48e0-a837-e4cadc9a8728'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:13:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ae0c60e1-0893-4760-818e-6db70862a24f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ae0c60e1-0893-4760-818e-6db70862a24f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ae0c60e1-0893-4760-818e-6db70862a24f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ae0c60e1-0893-4760-818e-6db70862a24f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ae0c60e1-0893-4760-818e-6db70862a24f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ae0c60e1-0893-4760-818e-6db70862a24f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:34 devstack sudo[89875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:13:34 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:34 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d65a202a-09f4-4637-9d82-1a89a8a1dcbf tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "cinder-cae2b1f9-053d-4b5c-80ed-ae244c85e6df-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:34 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d65a202a-09f4-4637-9d82-1a89a8a1dcbf tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-cae2b1f9-053d-4b5c-80ed-ae244c85e6df-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:34 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d65a202a-09f4-4637-9d82-1a89a8a1dcbf tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "cinder-quobyte-cae2b1f9-053d-4b5c-80ed-ae244c85e6df" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:34 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d65a202a-09f4-4637-9d82-1a89a8a1dcbf tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-cae2b1f9-053d-4b5c-80ed-ae244c85e6df" acquired by "delete_volume" :: waited 0.006s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:34 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d0a6be-2193-4ff5-9b56-d7a7fdd263c9]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d65a202a-09f4-4637-9d82-1a89a8a1dcbf tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cae2b1f9-053d-4b5c-80ed-ae244c85e6df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:34 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ae0c60e1-0893-4760-818e-6db70862a24f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.458s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:34 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-ae0c60e1-0893-4760-818e-6db70862a24f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:13:34 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-ae0c60e1-0893-4760-818e-6db70862a24f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Deleted volume successfully. Apr 15 20:13:34 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ae0c60e1-0893-4760-818e-6db70862a24f tempest-CreateVolumesFromSourceVolumeTest-197048886 None] Lock "cinder-210c153e-62d8-417e-8507-ea78bbe480b0-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:34 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cae2b1f9-053d-4b5c-80ed-ae244c85e6df Apr 15 20:13:34 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:35 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d65a202a-09f4-4637-9d82-1a89a8a1dcbf tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cae2b1f9-053d-4b5c-80ed-ae244c85e6df" returned: 0 in 0.515s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d65a202a-09f4-4637-9d82-1a89a8a1dcbf tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cae2b1f9-053d-4b5c-80ed-ae244c85e6df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:35 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cae2b1f9-053d-4b5c-80ed-ae244c85e6df Apr 15 20:13:35 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:35 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d65a202a-09f4-4637-9d82-1a89a8a1dcbf tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-cae2b1f9-053d-4b5c-80ed-ae244c85e6df" returned: 0 in 0.416s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d65a202a-09f4-4637-9d82-1a89a8a1dcbf tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-cae2b1f9-053d-4b5c-80ed-ae244c85e6df" released by "delete_volume" :: held 0.952s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG dbcounter [-] [82989] Writing DB stats cinder:SELECT=160,cinder:UPDATE=175,cinder:INSERT=40,cinder:DELETE=21 {{(pid=82989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-d65a202a-09f4-4637-9d82-1a89a8a1dcbf tempest-VolumesSnapshotTestJSON-1226514416 None] Created reservations ['5a256ce2-7b67-45f8-8caa-36887b8b689a', '450d0085-392a-4319-8125-1d255e9fcc39', '5d13d2c1-8e7b-4923-aa4e-1e644a9fcf87', 'a210d77d-328f-4a75-8809-8dfbfa5bbd9b'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d65a202a-09f4-4637-9d82-1a89a8a1dcbf tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d65a202a-09f4-4637-9d82-1a89a8a1dcbf tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d65a202a-09f4-4637-9d82-1a89a8a1dcbf tempest-VolumesSnapshotTestJSON-1226514416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d65a202a-09f4-4637-9d82-1a89a8a1dcbf tempest-VolumesSnapshotTestJSON-1226514416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d65a202a-09f4-4637-9d82-1a89a8a1dcbf tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d65a202a-09f4-4637-9d82-1a89a8a1dcbf tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:35 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:13:35 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5903b41c-ac82-4b7a-a853-3297df1431f6 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "cinder-97f48699-cf7b-4d30-ab11-3ae668dd4870-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5903b41c-ac82-4b7a-a853-3297df1431f6 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-97f48699-cf7b-4d30-ab11-3ae668dd4870-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5903b41c-ac82-4b7a-a853-3297df1431f6 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "cinder-quobyte-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5903b41c-ac82-4b7a-a853-3297df1431f6 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5903b41c-ac82-4b7a-a853-3297df1431f6 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "cinder-quobyte-97f48699-cf7b-4d30-ab11-3ae668dd4870" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5903b41c-ac82-4b7a-a853-3297df1431f6 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-97f48699-cf7b-4d30-ab11-3ae668dd4870" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-5903b41c-ac82-4b7a-a853-3297df1431f6 tempest-VolumesSnapshotTestJSON-1226514416 None] Deleting offline snapshot 97f48699-cf7b-4d30-ab11-3ae668dd4870 of volume fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-5903b41c-ac82-4b7a-a853-3297df1431f6 tempest-VolumesSnapshotTestJSON-1226514416 None] snapshot_file for this snap is: volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.97f48699-cf7b-4d30-ab11-3ae668dd4870 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0866cf-583f-46f5-8514-21ad509b5d4f]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5903b41c-ac82-4b7a-a853-3297df1431f6 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.97f48699-cf7b-4d30-ab11-3ae668dd4870 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:35 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.97f48699-cf7b-4d30-ab11-3ae668dd4870 Apr 15 20:13:35 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:35 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d65a202a-09f4-4637-9d82-1a89a8a1dcbf tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.416s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:35 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-d65a202a-09f4-4637-9d82-1a89a8a1dcbf tempest-VolumesSnapshotTestJSON-1226514416 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:13:36 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-d65a202a-09f4-4637-9d82-1a89a8a1dcbf tempest-VolumesSnapshotTestJSON-1226514416 None] Deleted volume successfully. Apr 15 20:13:36 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d65a202a-09f4-4637-9d82-1a89a8a1dcbf tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-cae2b1f9-053d-4b5c-80ed-ae244c85e6df-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:36 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5903b41c-ac82-4b7a-a853-3297df1431f6 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.97f48699-cf7b-4d30-ab11-3ae668dd4870" returned: 0 in 0.446s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:36 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-5903b41c-ac82-4b7a-a853-3297df1431f6 tempest-VolumesSnapshotTestJSON-1226514416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:13:36 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[4352e62c-8507-4501-a20b-22c05c02d4ba]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5903b41c-ac82-4b7a-a853-3297df1431f6 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:36 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 Apr 15 20:13:36 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:36 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5903b41c-ac82-4b7a-a853-3297df1431f6 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3" returned: 0 in 0.441s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5903b41c-ac82-4b7a-a853-3297df1431f6 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.97f48699-cf7b-4d30-ab11-3ae668dd4870 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:36 devstack sudo[89899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.97f48699-cf7b-4d30-ab11-3ae668dd4870 Apr 15 20:13:36 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:37 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5903b41c-ac82-4b7a-a853-3297df1431f6 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.97f48699-cf7b-4d30-ab11-3ae668dd4870" returned: 0 in 0.423s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5903b41c-ac82-4b7a-a853-3297df1431f6 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.97f48699-cf7b-4d30-ab11-3ae668dd4870 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:37 devstack sudo[89904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.97f48699-cf7b-4d30-ab11-3ae668dd4870 Apr 15 20:13:37 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:37 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5903b41c-ac82-4b7a-a853-3297df1431f6 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3.97f48699-cf7b-4d30-ab11-3ae668dd4870" returned: 0 in 0.392s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:37 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5903b41c-ac82-4b7a-a853-3297df1431f6 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-97f48699-cf7b-4d30-ab11-3ae668dd4870" released by "_delete_snapshot" :: held 1.751s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:37 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5903b41c-ac82-4b7a-a853-3297df1431f6 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3" released by "delete_snapshot" :: held 1.762s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:37 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-5903b41c-ac82-4b7a-a853-3297df1431f6 tempest-VolumesSnapshotTestJSON-1226514416 None] Created reservations ['bf3585f2-a999-40f1-8900-83a60901521d', 'd9c5cdbb-57c1-4962-855e-d73c636ca0ea', '9830c0dc-57f3-4a53-8d0a-65a1647c4723', '4dde36a3-eb0b-4655-9079-b6fa93ce24ac'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:13:37 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-5903b41c-ac82-4b7a-a853-3297df1431f6 tempest-VolumesSnapshotTestJSON-1226514416 None] Delete snapshot completed successfully. Apr 15 20:13:37 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-5903b41c-ac82-4b7a-a853-3297df1431f6 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-97f48699-cf7b-4d30-ab11-3ae668dd4870-delete_snapshot" released by "delete_snapshot" :: held 1.840s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:37 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b6ffde31-cc59-421e-98d4-e13917126ce0 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "cinder-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:37 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b6ffde31-cc59-421e-98d4-e13917126ce0 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:37 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b6ffde31-cc59-421e-98d4-e13917126ce0 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "cinder-quobyte-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:37 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b6ffde31-cc59-421e-98d4-e13917126ce0 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3" acquired by "delete_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:37 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa43b62d-7209-41f7-9e8e-89194f993f01]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b6ffde31-cc59-421e-98d4-e13917126ce0 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:37 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 Apr 15 20:13:37 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:38 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b6ffde31-cc59-421e-98d4-e13917126ce0 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3" returned: 0 in 0.453s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b6ffde31-cc59-421e-98d4-e13917126ce0 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:38 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3 Apr 15 20:13:38 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:38 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b6ffde31-cc59-421e-98d4-e13917126ce0 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3" returned: 0 in 0.382s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:38 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b6ffde31-cc59-421e-98d4-e13917126ce0 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3" released by "delete_volume" :: held 0.869s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:38 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-b6ffde31-cc59-421e-98d4-e13917126ce0 tempest-VolumesSnapshotTestJSON-1226514416 None] Created reservations ['0eef41d9-2646-4d4a-8f66-3e7037d93f6e', 'f35cf8a5-bc22-434a-b32c-3caa97f7951b', '6e4d5f69-da71-4389-92b2-70fc59536097', '0809f883-e5c7-4403-8cb5-f47285812bb7'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:13:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b6ffde31-cc59-421e-98d4-e13917126ce0 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b6ffde31-cc59-421e-98d4-e13917126ce0 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:38 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b6ffde31-cc59-421e-98d4-e13917126ce0 tempest-VolumesSnapshotTestJSON-1226514416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:38 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b6ffde31-cc59-421e-98d4-e13917126ce0 tempest-VolumesSnapshotTestJSON-1226514416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b6ffde31-cc59-421e-98d4-e13917126ce0 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b6ffde31-cc59-421e-98d4-e13917126ce0 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:38 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:13:38 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d1583bb5-07a7-4f96-9b23-548483a609b5 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "cinder-2b710358-4dfd-4fb2-adb9-6b315b941c68-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d1583bb5-07a7-4f96-9b23-548483a609b5 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-2b710358-4dfd-4fb2-adb9-6b315b941c68-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d1583bb5-07a7-4f96-9b23-548483a609b5 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "cinder-quobyte-2b710358-4dfd-4fb2-adb9-6b315b941c68" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d1583bb5-07a7-4f96-9b23-548483a609b5 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-2b710358-4dfd-4fb2-adb9-6b315b941c68" acquired by "delete_volume" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:39 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5c64ba-403c-4061-b325-4a68beacac3e]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d1583bb5-07a7-4f96-9b23-548483a609b5 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:39 devstack sudo[89917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68 Apr 15 20:13:39 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:39 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b6ffde31-cc59-421e-98d4-e13917126ce0 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.417s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:39 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-b6ffde31-cc59-421e-98d4-e13917126ce0 tempest-VolumesSnapshotTestJSON-1226514416 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:13:39 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-b6ffde31-cc59-421e-98d4-e13917126ce0 tempest-VolumesSnapshotTestJSON-1226514416 None] Deleted volume successfully. Apr 15 20:13:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-b6ffde31-cc59-421e-98d4-e13917126ce0 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-fd3f2ff0-1382-42b0-b5ca-dd53b6751eb3-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:39 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d1583bb5-07a7-4f96-9b23-548483a609b5 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68" returned: 0 in 0.468s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d1583bb5-07a7-4f96-9b23-548483a609b5 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:39 devstack sudo[89923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68 Apr 15 20:13:39 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:39 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d1583bb5-07a7-4f96-9b23-548483a609b5 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2b710358-4dfd-4fb2-adb9-6b315b941c68" returned: 0 in 0.427s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d1583bb5-07a7-4f96-9b23-548483a609b5 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-quobyte-2b710358-4dfd-4fb2-adb9-6b315b941c68" released by "delete_volume" :: held 0.927s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:40 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-d1583bb5-07a7-4f96-9b23-548483a609b5 tempest-VolumesSnapshotTestJSON-1226514416 None] Created reservations ['16037c20-5ba5-4961-9841-ad23e4b8646c', '4cfe7f18-d59a-4764-aab1-f21daeda8641', 'd6df5649-e6b3-41ea-ba1e-aa33666ee945', '62579a0a-2b94-477c-a081-341acdcbf62c'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:13:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d1583bb5-07a7-4f96-9b23-548483a609b5 tempest-VolumesSnapshotTestJSON-1226514416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d1583bb5-07a7-4f96-9b23-548483a609b5 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d1583bb5-07a7-4f96-9b23-548483a609b5 tempest-VolumesSnapshotTestJSON-1226514416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-d1583bb5-07a7-4f96-9b23-548483a609b5 tempest-VolumesSnapshotTestJSON-1226514416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d1583bb5-07a7-4f96-9b23-548483a609b5 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d1583bb5-07a7-4f96-9b23-548483a609b5 tempest-VolumesSnapshotTestJSON-1226514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:40 devstack sudo[89926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:13:40 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:40 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d1583bb5-07a7-4f96-9b23-548483a609b5 tempest-VolumesSnapshotTestJSON-1226514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.444s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:40 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-d1583bb5-07a7-4f96-9b23-548483a609b5 tempest-VolumesSnapshotTestJSON-1226514416 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:13:40 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-d1583bb5-07a7-4f96-9b23-548483a609b5 tempest-VolumesSnapshotTestJSON-1226514416 None] Deleted volume successfully. Apr 15 20:13:40 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-d1583bb5-07a7-4f96-9b23-548483a609b5 tempest-VolumesSnapshotTestJSON-1226514416 None] Lock "cinder-2b710358-4dfd-4fb2-adb9-6b315b941c68-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:43 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:13:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Flow 'volume_create_manager' (3c91e206-d244-467a-be3a-5fbe43d0057e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:13:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b230bdba-3dcc-4151-bc82-4b2466e04dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b230bdba-3dcc-4151-bc82-4b2466e04dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1771847234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adbfa8ee-c4e0-401d-80a9-75245d861a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3759bd05a1394024a82e827fcdacf975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:44Z,use_quota=True,user_id='7de31c39736d4673bd2e582eed315d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02c75b1-1d2e-465e-872b-b2d6b9836350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02c75b1-1d2e-465e-872b-b2d6b9836350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87cad68-d1fb-445c-b36d-b5ef5772627e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87cad68-d1fb-445c-b36d-b5ef5772627e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adbfa8ee-c4e0-401d-80a9-75245d861a28', 'volume_name': 'volume-adbfa8ee-c4e0-401d-80a9-75245d861a28', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6010b028-074e-4c96-afe8-1414d560e265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6010b028-074e-4c96-afe8-1414d560e265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706574f8-152d-4626-a025-71d1c9d30f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:43 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Volume adbfa8ee-c4e0-401d-80a9-75245d861a28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adbfa8ee-c4e0-401d-80a9-75245d861a28', 'volume_size': 1} Apr 15 20:13:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1771847234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adbfa8ee-c4e0-401d-80a9-75245d861a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3759bd05a1394024a82e827fcdacf975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:13:44Z,use_quota=True,user_id='7de31c39736d4673bd2e582eed315d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:13:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Creating volume adbfa8ee-c4e0-401d-80a9-75245d861a28 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:13:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:13:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:13:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:13:43 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:13:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:43 devstack sudo[89932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28 1073741824 Apr 15 20:13:43 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:44 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28 1073741824" returned: 0 in 0.446s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:44 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28 Apr 15 20:13:44 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:44 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28" returned: 0 in 0.408s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:44 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:13:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706574f8-152d-4626-a025-71d1c9d30f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adbfa8ee-c4e0-401d-80a9-75245d861a28', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd49eb7-90f9-419e-8a60-05f82a4e9513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:13:44 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Volume volume-adbfa8ee-c4e0-401d-80a9-75245d861a28 (adbfa8ee-c4e0-401d-80a9-75245d861a28): created successfully Apr 15 20:13:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd49eb7-90f9-419e-8a60-05f82a4e9513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:13:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Flow 'volume_create_manager' (3c91e206-d244-467a-be3a-5fbe43d0057e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:13:44 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-9bfbcea1-d914-459a-b818-e9fff6d33a6b tempest-VolumesSnapshotListTestJSON-1323153950 None] Created volume successfully. Apr 15 20:13:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5a31c713-7494-4dd2-a886-48113d9fa0c1 tempest-VolumesSnapshotListTestJSON-1323153950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5a31c713-7494-4dd2-a886-48113d9fa0c1 tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:44 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-5a31c713-7494-4dd2-a886-48113d9fa0c1 tempest-VolumesSnapshotListTestJSON-1323153950 None] Creating offline snapshot c66d0d06-7128-49bd-b808-5efb477ba34e of volume adbfa8ee-c4e0-401d-80a9-75245d861a28 {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:13:44 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[476a67ff-184a-49a7-90c8-b3a466392787]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a31c713-7494-4dd2-a886-48113d9fa0c1 tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:45 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28 Apr 15 20:13:45 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:45 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a31c713-7494-4dd2-a886-48113d9fa0c1 tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28" returned: 0 in 0.443s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a31c713-7494-4dd2-a886-48113d9fa0c1 tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:45 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e 1G Apr 15 20:13:45 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:45 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a31c713-7494-4dd2-a886-48113d9fa0c1 tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e 1G" returned: 0 in 0.459s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a31c713-7494-4dd2-a886-48113d9fa0c1 tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adbfa8ee-c4e0-401d-80a9-75245d861a28 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:45 devstack sudo[89950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adbfa8ee-c4e0-401d-80a9-75245d861a28 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e Apr 15 20:13:45 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:46 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a31c713-7494-4dd2-a886-48113d9fa0c1 tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adbfa8ee-c4e0-401d-80a9-75245d861a28 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e" returned: 0 in 0.414s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:46 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-5a31c713-7494-4dd2-a886-48113d9fa0c1 tempest-VolumesSnapshotListTestJSON-1323153950 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e is being set with open permissions: ugo+rw Apr 15 20:13:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a31c713-7494-4dd2-a886-48113d9fa0c1 tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:46 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e Apr 15 20:13:46 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:46 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a31c713-7494-4dd2-a886-48113d9fa0c1 tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e" returned: 0 in 0.390s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a31c713-7494-4dd2-a886-48113d9fa0c1 tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:46 devstack sudo[89958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.info Apr 15 20:13:46 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:47 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a31c713-7494-4dd2-a886-48113d9fa0c1 tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.info" returned: 0 in 0.391s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:47 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-5a31c713-7494-4dd2-a886-48113d9fa0c1 tempest-VolumesSnapshotListTestJSON-1323153950 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.info is being set with open permissions: ugo+rw Apr 15 20:13:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a31c713-7494-4dd2-a886-48113d9fa0c1 tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:47 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.info Apr 15 20:13:47 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:47 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-5a31c713-7494-4dd2-a886-48113d9fa0c1 tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.info" returned: 0 in 0.381s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-5a31c713-7494-4dd2-a886-48113d9fa0c1 tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.535s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:47 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-5a31c713-7494-4dd2-a886-48113d9fa0c1 tempest-VolumesSnapshotListTestJSON-1323153950 None] Create snapshot completed successfully Apr 15 20:13:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2fd66f13-389a-4b41-a80c-e7519e11cbb2 tempest-VolumesSnapshotListTestJSON-1323153950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2fd66f13-389a-4b41-a80c-e7519e11cbb2 tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-2fd66f13-389a-4b41-a80c-e7519e11cbb2 tempest-VolumesSnapshotListTestJSON-1323153950 None] Creating offline snapshot 6323ed90-0966-4645-90ee-dbeda9af5858 of volume adbfa8ee-c4e0-401d-80a9-75245d861a28 {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:13:48 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc666b0-5b5a-484e-bdff-0e5ba3d844a9]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2fd66f13-389a-4b41-a80c-e7519e11cbb2 tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:48 devstack sudo[89965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e Apr 15 20:13:48 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:48 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2fd66f13-389a-4b41-a80c-e7519e11cbb2 tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e" returned: 0 in 0.445s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-2fd66f13-389a-4b41-a80c-e7519e11cbb2 tempest-VolumesSnapshotListTestJSON-1323153950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adbfa8ee-c4e0-401d-80a9-75245d861a28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:13:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2fd66f13-389a-4b41-a80c-e7519e11cbb2 tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:48 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858 1G Apr 15 20:13:48 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:49 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2fd66f13-389a-4b41-a80c-e7519e11cbb2 tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858 1G" returned: 0 in 0.468s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2fd66f13-389a-4b41-a80c-e7519e11cbb2 tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:49 devstack sudo[89975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858 Apr 15 20:13:49 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:49 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2fd66f13-389a-4b41-a80c-e7519e11cbb2 tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858" returned: 0 in 0.453s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:49 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-2fd66f13-389a-4b41-a80c-e7519e11cbb2 tempest-VolumesSnapshotListTestJSON-1323153950 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858 is being set with open permissions: ugo+rw Apr 15 20:13:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2fd66f13-389a-4b41-a80c-e7519e11cbb2 tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:49 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858 Apr 15 20:13:49 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:49 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2fd66f13-389a-4b41-a80c-e7519e11cbb2 tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858" returned: 0 in 0.405s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2fd66f13-389a-4b41-a80c-e7519e11cbb2 tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.821s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:49 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-2fd66f13-389a-4b41-a80c-e7519e11cbb2 tempest-VolumesSnapshotListTestJSON-1323153950 None] Create snapshot completed successfully Apr 15 20:13:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ba5cf4b8-bac8-48c1-b51c-cee7be64405e tempest-VolumesSnapshotListTestJSON-1323153950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:13:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ba5cf4b8-bac8-48c1-b51c-cee7be64405e tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:13:50 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-ba5cf4b8-bac8-48c1-b51c-cee7be64405e tempest-VolumesSnapshotListTestJSON-1323153950 None] Creating offline snapshot 0a98e16d-26e4-4829-b183-0e15c618a00d of volume adbfa8ee-c4e0-401d-80a9-75245d861a28 {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:13:50 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4badd45-107d-4e04-8795-ab30ac024014]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ba5cf4b8-bac8-48c1-b51c-cee7be64405e tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:50 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858 Apr 15 20:13:50 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:50 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ba5cf4b8-bac8-48c1-b51c-cee7be64405e tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858" returned: 0 in 0.472s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:50 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-ba5cf4b8-bac8-48c1-b51c-cee7be64405e tempest-VolumesSnapshotListTestJSON-1323153950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adbfa8ee-c4e0-401d-80a9-75245d861a28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:13:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ba5cf4b8-bac8-48c1-b51c-cee7be64405e tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.0a98e16d-26e4-4829-b183-0e15c618a00d 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:50 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.0a98e16d-26e4-4829-b183-0e15c618a00d 1G Apr 15 20:13:50 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:51 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ba5cf4b8-bac8-48c1-b51c-cee7be64405e tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.0a98e16d-26e4-4829-b183-0e15c618a00d 1G" returned: 0 in 0.511s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ba5cf4b8-bac8-48c1-b51c-cee7be64405e tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.0a98e16d-26e4-4829-b183-0e15c618a00d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:51 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.0a98e16d-26e4-4829-b183-0e15c618a00d Apr 15 20:13:51 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:51 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ba5cf4b8-bac8-48c1-b51c-cee7be64405e tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.0a98e16d-26e4-4829-b183-0e15c618a00d" returned: 0 in 0.439s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:51 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-ba5cf4b8-bac8-48c1-b51c-cee7be64405e tempest-VolumesSnapshotListTestJSON-1323153950 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.0a98e16d-26e4-4829-b183-0e15c618a00d is being set with open permissions: ugo+rw Apr 15 20:13:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ba5cf4b8-bac8-48c1-b51c-cee7be64405e tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.0a98e16d-26e4-4829-b183-0e15c618a00d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:51 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.0a98e16d-26e4-4829-b183-0e15c618a00d Apr 15 20:13:51 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:52 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ba5cf4b8-bac8-48c1-b51c-cee7be64405e tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.0a98e16d-26e4-4829-b183-0e15c618a00d" returned: 0 in 0.415s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ba5cf4b8-bac8-48c1-b51c-cee7be64405e tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.887s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:13:52 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-ba5cf4b8-bac8-48c1-b51c-cee7be64405e tempest-VolumesSnapshotListTestJSON-1323153950 None] Create snapshot completed successfully Apr 15 20:13:52 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-408f3f9f-3790-4db6-b2e9-56c999725be3 tempest-VolumesSnapshotListTestJSON-1323153950 None] Acquiring lock "cinder-0a98e16d-26e4-4829-b183-0e15c618a00d-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:52 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-408f3f9f-3790-4db6-b2e9-56c999725be3 tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "cinder-0a98e16d-26e4-4829-b183-0e15c618a00d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:52 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-408f3f9f-3790-4db6-b2e9-56c999725be3 tempest-VolumesSnapshotListTestJSON-1323153950 None] Acquiring lock "cinder-quobyte-adbfa8ee-c4e0-401d-80a9-75245d861a28" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:52 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-408f3f9f-3790-4db6-b2e9-56c999725be3 tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "cinder-quobyte-adbfa8ee-c4e0-401d-80a9-75245d861a28" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:52 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-408f3f9f-3790-4db6-b2e9-56c999725be3 tempest-VolumesSnapshotListTestJSON-1323153950 None] Acquiring lock "cinder-quobyte-0a98e16d-26e4-4829-b183-0e15c618a00d" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:52 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-408f3f9f-3790-4db6-b2e9-56c999725be3 tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "cinder-quobyte-0a98e16d-26e4-4829-b183-0e15c618a00d" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:52 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-408f3f9f-3790-4db6-b2e9-56c999725be3 tempest-VolumesSnapshotListTestJSON-1323153950 None] Deleting offline snapshot 0a98e16d-26e4-4829-b183-0e15c618a00d of volume adbfa8ee-c4e0-401d-80a9-75245d861a28 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:13:52 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-408f3f9f-3790-4db6-b2e9-56c999725be3 tempest-VolumesSnapshotListTestJSON-1323153950 None] snapshot_file for this snap is: volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.0a98e16d-26e4-4829-b183-0e15c618a00d {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:13:52 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0034e62-654b-4343-9ceb-9078c466ea11]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-408f3f9f-3790-4db6-b2e9-56c999725be3 tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.0a98e16d-26e4-4829-b183-0e15c618a00d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:53 devstack sudo[90002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.0a98e16d-26e4-4829-b183-0e15c618a00d Apr 15 20:13:53 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:53 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-408f3f9f-3790-4db6-b2e9-56c999725be3 tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.0a98e16d-26e4-4829-b183-0e15c618a00d" returned: 0 in 0.453s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:53 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-408f3f9f-3790-4db6-b2e9-56c999725be3 tempest-VolumesSnapshotListTestJSON-1323153950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adbfa8ee-c4e0-401d-80a9-75245d861a28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:13:53 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d51daa0-bb86-41b4-9dcd-dae28f6ab16c]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-408f3f9f-3790-4db6-b2e9-56c999725be3 tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:53 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858 Apr 15 20:13:53 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:53 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-408f3f9f-3790-4db6-b2e9-56c999725be3 tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858" returned: 0 in 0.457s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:53 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-408f3f9f-3790-4db6-b2e9-56c999725be3 tempest-VolumesSnapshotListTestJSON-1323153950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adbfa8ee-c4e0-401d-80a9-75245d861a28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:13:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-408f3f9f-3790-4db6-b2e9-56c999725be3 tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.0a98e16d-26e4-4829-b183-0e15c618a00d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:53 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.0a98e16d-26e4-4829-b183-0e15c618a00d Apr 15 20:13:53 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:54 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-408f3f9f-3790-4db6-b2e9-56c999725be3 tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.0a98e16d-26e4-4829-b183-0e15c618a00d" returned: 0 in 0.469s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-408f3f9f-3790-4db6-b2e9-56c999725be3 tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.0a98e16d-26e4-4829-b183-0e15c618a00d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:54 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.0a98e16d-26e4-4829-b183-0e15c618a00d Apr 15 20:13:54 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:54 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-408f3f9f-3790-4db6-b2e9-56c999725be3 tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.0a98e16d-26e4-4829-b183-0e15c618a00d" returned: 0 in 0.398s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:54 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-408f3f9f-3790-4db6-b2e9-56c999725be3 tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "cinder-quobyte-0a98e16d-26e4-4829-b183-0e15c618a00d" released by "_delete_snapshot" :: held 1.821s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:54 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-408f3f9f-3790-4db6-b2e9-56c999725be3 tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "cinder-quobyte-adbfa8ee-c4e0-401d-80a9-75245d861a28" released by "delete_snapshot" :: held 1.831s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:54 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-408f3f9f-3790-4db6-b2e9-56c999725be3 tempest-VolumesSnapshotListTestJSON-1323153950 None] Created reservations ['91091cc4-00b3-4a98-a015-ebf5a45d1cf3', '1e79f41f-ad8c-413d-beb8-ce87d9c0ae9e', '9864f52a-547e-4a96-99a0-f67548960928', '917d7de4-9659-407a-870c-e6dfe9e5967b'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:13:54 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-408f3f9f-3790-4db6-b2e9-56c999725be3 tempest-VolumesSnapshotListTestJSON-1323153950 None] Delete snapshot completed successfully. Apr 15 20:13:54 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-408f3f9f-3790-4db6-b2e9-56c999725be3 tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "cinder-0a98e16d-26e4-4829-b183-0e15c618a00d-delete_snapshot" released by "delete_snapshot" :: held 1.908s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:55 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3567c434-1327-4ade-a26a-9b0c46a8c475 tempest-VolumesSnapshotListTestJSON-1323153950 None] Acquiring lock "cinder-6323ed90-0966-4645-90ee-dbeda9af5858-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:55 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3567c434-1327-4ade-a26a-9b0c46a8c475 tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "cinder-6323ed90-0966-4645-90ee-dbeda9af5858-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:55 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3567c434-1327-4ade-a26a-9b0c46a8c475 tempest-VolumesSnapshotListTestJSON-1323153950 None] Acquiring lock "cinder-quobyte-adbfa8ee-c4e0-401d-80a9-75245d861a28" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:55 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3567c434-1327-4ade-a26a-9b0c46a8c475 tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "cinder-quobyte-adbfa8ee-c4e0-401d-80a9-75245d861a28" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:55 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3567c434-1327-4ade-a26a-9b0c46a8c475 tempest-VolumesSnapshotListTestJSON-1323153950 None] Acquiring lock "cinder-quobyte-6323ed90-0966-4645-90ee-dbeda9af5858" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:55 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3567c434-1327-4ade-a26a-9b0c46a8c475 tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "cinder-quobyte-6323ed90-0966-4645-90ee-dbeda9af5858" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-3567c434-1327-4ade-a26a-9b0c46a8c475 tempest-VolumesSnapshotListTestJSON-1323153950 None] Deleting offline snapshot 6323ed90-0966-4645-90ee-dbeda9af5858 of volume adbfa8ee-c4e0-401d-80a9-75245d861a28 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:13:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-3567c434-1327-4ade-a26a-9b0c46a8c475 tempest-VolumesSnapshotListTestJSON-1323153950 None] snapshot_file for this snap is: volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:13:55 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[505fb0bb-12d4-4939-bf63-b4c1a97e486c]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3567c434-1327-4ade-a26a-9b0c46a8c475 tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:55 devstack sudo[90020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858 Apr 15 20:13:55 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:55 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3567c434-1327-4ade-a26a-9b0c46a8c475 tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858" returned: 0 in 0.450s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-3567c434-1327-4ade-a26a-9b0c46a8c475 tempest-VolumesSnapshotListTestJSON-1323153950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adbfa8ee-c4e0-401d-80a9-75245d861a28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:13:55 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bab17e-e79e-463f-a2ec-33a6adb26f31]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3567c434-1327-4ade-a26a-9b0c46a8c475 tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:55 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e Apr 15 20:13:55 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:56 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3567c434-1327-4ade-a26a-9b0c46a8c475 tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e" returned: 0 in 0.447s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:56 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-3567c434-1327-4ade-a26a-9b0c46a8c475 tempest-VolumesSnapshotListTestJSON-1323153950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adbfa8ee-c4e0-401d-80a9-75245d861a28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:13:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3567c434-1327-4ade-a26a-9b0c46a8c475 tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:56 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858 Apr 15 20:13:56 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:56 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3567c434-1327-4ade-a26a-9b0c46a8c475 tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858" returned: 0 in 0.440s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3567c434-1327-4ade-a26a-9b0c46a8c475 tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:56 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858 Apr 15 20:13:56 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:56 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3567c434-1327-4ade-a26a-9b0c46a8c475 tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.6323ed90-0966-4645-90ee-dbeda9af5858" returned: 0 in 0.392s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:56 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3567c434-1327-4ade-a26a-9b0c46a8c475 tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "cinder-quobyte-6323ed90-0966-4645-90ee-dbeda9af5858" released by "_delete_snapshot" :: held 1.772s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:56 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3567c434-1327-4ade-a26a-9b0c46a8c475 tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "cinder-quobyte-adbfa8ee-c4e0-401d-80a9-75245d861a28" released by "delete_snapshot" :: held 1.787s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:56 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-3567c434-1327-4ade-a26a-9b0c46a8c475 tempest-VolumesSnapshotListTestJSON-1323153950 None] Created reservations ['e7af5865-35e6-44fd-aa71-1bb536da9f98', '6577c532-8af0-4874-a1a3-0331717d17e7', '5d01e129-3a95-4041-8643-195ba613a321', 'cecd4d63-d80c-4e9a-b641-0c5cbbb1e2f6'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:13:56 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-3567c434-1327-4ade-a26a-9b0c46a8c475 tempest-VolumesSnapshotListTestJSON-1323153950 None] Delete snapshot completed successfully. Apr 15 20:13:56 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3567c434-1327-4ade-a26a-9b0c46a8c475 tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "cinder-6323ed90-0966-4645-90ee-dbeda9af5858-delete_snapshot" released by "delete_snapshot" :: held 1.868s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:57 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1a690290-6b1e-4643-93d5-92222c684f5e tempest-VolumesSnapshotListTestJSON-1323153950 None] Acquiring lock "cinder-c66d0d06-7128-49bd-b808-5efb477ba34e-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:57 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1a690290-6b1e-4643-93d5-92222c684f5e tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "cinder-c66d0d06-7128-49bd-b808-5efb477ba34e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:57 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1a690290-6b1e-4643-93d5-92222c684f5e tempest-VolumesSnapshotListTestJSON-1323153950 None] Acquiring lock "cinder-quobyte-adbfa8ee-c4e0-401d-80a9-75245d861a28" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:57 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1a690290-6b1e-4643-93d5-92222c684f5e tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "cinder-quobyte-adbfa8ee-c4e0-401d-80a9-75245d861a28" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:57 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1a690290-6b1e-4643-93d5-92222c684f5e tempest-VolumesSnapshotListTestJSON-1323153950 None] Acquiring lock "cinder-quobyte-c66d0d06-7128-49bd-b808-5efb477ba34e" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:57 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1a690290-6b1e-4643-93d5-92222c684f5e tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "cinder-quobyte-c66d0d06-7128-49bd-b808-5efb477ba34e" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:57 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-1a690290-6b1e-4643-93d5-92222c684f5e tempest-VolumesSnapshotListTestJSON-1323153950 None] Deleting offline snapshot c66d0d06-7128-49bd-b808-5efb477ba34e of volume adbfa8ee-c4e0-401d-80a9-75245d861a28 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:13:57 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-1a690290-6b1e-4643-93d5-92222c684f5e tempest-VolumesSnapshotListTestJSON-1323153950 None] snapshot_file for this snap is: volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:13:57 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[738cfc60-751d-452b-a679-15e4aac4c62e]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1a690290-6b1e-4643-93d5-92222c684f5e tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:57 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e Apr 15 20:13:57 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:57 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1a690290-6b1e-4643-93d5-92222c684f5e tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e" returned: 0 in 0.442s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:57 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-1a690290-6b1e-4643-93d5-92222c684f5e tempest-VolumesSnapshotListTestJSON-1323153950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adbfa8ee-c4e0-401d-80a9-75245d861a28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:13:57 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f591294-7d8d-4dd9-b88b-b250acaed803]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1a690290-6b1e-4643-93d5-92222c684f5e tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:57 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28 Apr 15 20:13:57 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:58 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1a690290-6b1e-4643-93d5-92222c684f5e tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28" returned: 0 in 0.443s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1a690290-6b1e-4643-93d5-92222c684f5e tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:58 devstack sudo[90048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e Apr 15 20:13:58 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:58 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1a690290-6b1e-4643-93d5-92222c684f5e tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e" returned: 0 in 0.431s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1a690290-6b1e-4643-93d5-92222c684f5e tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:58 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e Apr 15 20:13:58 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:58 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1a690290-6b1e-4643-93d5-92222c684f5e tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28.c66d0d06-7128-49bd-b808-5efb477ba34e" returned: 0 in 0.382s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:58 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1a690290-6b1e-4643-93d5-92222c684f5e tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "cinder-quobyte-c66d0d06-7128-49bd-b808-5efb477ba34e" released by "_delete_snapshot" :: held 1.748s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:58 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1a690290-6b1e-4643-93d5-92222c684f5e tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "cinder-quobyte-adbfa8ee-c4e0-401d-80a9-75245d861a28" released by "delete_snapshot" :: held 1.760s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:59 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-1a690290-6b1e-4643-93d5-92222c684f5e tempest-VolumesSnapshotListTestJSON-1323153950 None] Created reservations ['eeeb2433-4b01-4d69-9a7e-15c83e3e7770', '95050906-bd56-4d1c-abd3-58f16d73f5b2', '8ebb7c1c-2037-4fd5-9283-db41c15f02bb', '6b314010-48a0-449f-9b20-cc108e54ba9a'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:13:59 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-1a690290-6b1e-4643-93d5-92222c684f5e tempest-VolumesSnapshotListTestJSON-1323153950 None] Delete snapshot completed successfully. Apr 15 20:13:59 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1a690290-6b1e-4643-93d5-92222c684f5e tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "cinder-c66d0d06-7128-49bd-b808-5efb477ba34e-delete_snapshot" released by "delete_snapshot" :: held 1.844s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:13:59 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-4f7e01c6-2cee-4487-8cab-305bfaea457a tempest-VolumesSnapshotListTestJSON-1323153950 None] Acquiring lock "cinder-adbfa8ee-c4e0-401d-80a9-75245d861a28-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:59 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-4f7e01c6-2cee-4487-8cab-305bfaea457a tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "cinder-adbfa8ee-c4e0-401d-80a9-75245d861a28-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:59 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-4f7e01c6-2cee-4487-8cab-305bfaea457a tempest-VolumesSnapshotListTestJSON-1323153950 None] Acquiring lock "cinder-quobyte-adbfa8ee-c4e0-401d-80a9-75245d861a28" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:13:59 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-4f7e01c6-2cee-4487-8cab-305bfaea457a tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "cinder-quobyte-adbfa8ee-c4e0-401d-80a9-75245d861a28" acquired by "delete_volume" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:13:59 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3850d8-50d7-4551-b830-df4932d864c4]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:13:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-4f7e01c6-2cee-4487-8cab-305bfaea457a tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:59 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28 Apr 15 20:13:59 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:13:59 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Apr 15 20:13:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-4f7e01c6-2cee-4487-8cab-305bfaea457a tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28" returned: 0 in 0.459s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:13:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-4f7e01c6-2cee-4487-8cab-305bfaea457a tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:13:59 devstack sudo[90061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28 Apr 15 20:13:59 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:00 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-4f7e01c6-2cee-4487-8cab-305bfaea457a tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-adbfa8ee-c4e0-401d-80a9-75245d861a28" returned: 0 in 0.414s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:00 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-4f7e01c6-2cee-4487-8cab-305bfaea457a tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "cinder-quobyte-adbfa8ee-c4e0-401d-80a9-75245d861a28" released by "delete_volume" :: held 0.905s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:00 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-4f7e01c6-2cee-4487-8cab-305bfaea457a tempest-VolumesSnapshotListTestJSON-1323153950 None] Created reservations ['5d71de10-9291-4ef6-9a8a-1b5e592522bb', 'b7b3ab73-c57a-4b27-b723-b1d38f5dcda6', 'fb71aa8c-9f48-4cbb-aa1f-109d5022b705', '6da42a05-50da-4336-9911-de45b54b3fb0'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:14:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-4f7e01c6-2cee-4487-8cab-305bfaea457a tempest-VolumesSnapshotListTestJSON-1323153950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-4f7e01c6-2cee-4487-8cab-305bfaea457a tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-4f7e01c6-2cee-4487-8cab-305bfaea457a tempest-VolumesSnapshotListTestJSON-1323153950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-4f7e01c6-2cee-4487-8cab-305bfaea457a tempest-VolumesSnapshotListTestJSON-1323153950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-4f7e01c6-2cee-4487-8cab-305bfaea457a tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-4f7e01c6-2cee-4487-8cab-305bfaea457a tempest-VolumesSnapshotListTestJSON-1323153950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:00 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:14:00 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:00 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-4f7e01c6-2cee-4487-8cab-305bfaea457a tempest-VolumesSnapshotListTestJSON-1323153950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.477s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:00 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-4f7e01c6-2cee-4487-8cab-305bfaea457a tempest-VolumesSnapshotListTestJSON-1323153950 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:14:00 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-4f7e01c6-2cee-4487-8cab-305bfaea457a tempest-VolumesSnapshotListTestJSON-1323153950 None] Deleted volume successfully. Apr 15 20:14:00 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-4f7e01c6-2cee-4487-8cab-305bfaea457a tempest-VolumesSnapshotListTestJSON-1323153950 None] Lock "cinder-adbfa8ee-c4e0-401d-80a9-75245d861a28-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Flow 'volume_create_manager' (94ee8451-d427-4cd9-96f8-521950ddab8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f022a6d8-66db-4361-bd99-90e0a1783f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f022a6d8-66db-4361-bd99-90e0a1783f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-657580385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceea0206-45e6-4bac-905b-772018d76b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb8be54d96c445f9f1f21515ff4f6a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:02Z,use_quota=True,user_id='4fd5bbadd2244bd8841d19ed00174ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3bad6ef-ba3e-4bb7-a31a-c75eea9901b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3bad6ef-ba3e-4bb7-a31a-c75eea9901b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002378b5-0adc-4cb6-81c8-8ef90bd856a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002378b5-0adc-4cb6-81c8-8ef90bd856a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceea0206-45e6-4bac-905b-772018d76b36', 'volume_name': 'volume-ceea0206-45e6-4bac-905b-772018d76b36', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30044a8d-46ad-462b-98ff-3725c2079018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30044a8d-46ad-462b-98ff-3725c2079018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c70b4f1-4a5f-4855-988a-5b61edd6a5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:02 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Volume ceea0206-45e6-4bac-905b-772018d76b36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceea0206-45e6-4bac-905b-772018d76b36', 'volume_size': 1} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-657580385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceea0206-45e6-4bac-905b-772018d76b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb8be54d96c445f9f1f21515ff4f6a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:02Z,use_quota=True,user_id='4fd5bbadd2244bd8841d19ed00174ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Creating volume ceea0206-45e6-4bac-905b-772018d76b36 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:14:02 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ceea0206-45e6-4bac-905b-772018d76b36 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:02 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ceea0206-45e6-4bac-905b-772018d76b36 1073741824 Apr 15 20:14:02 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Flow 'volume_create_manager' (e91d380f-1d97-4c43-965a-9b0d2ccf33bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c533640-8d27-4c00-9f83-6b5b4c687c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c533640-8d27-4c00-9f83-6b5b4c687c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-707424046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb8be54d96c445f9f1f21515ff4f6a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:02Z,use_quota=True,user_id='4fd5bbadd2244bd8841d19ed00174ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8815b2bf-995b-4ba0-9af0-f0046dff29c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8815b2bf-995b-4ba0-9af0-f0046dff29c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651701a1-3c10-427e-8204-2b9fefec6ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651701a1-3c10-427e-8204-2b9fefec6ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1', 'volume_name': 'volume-5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f50fc5-f611-48ce-9e73-aa893e369ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f50fc5-f611-48ce-9e73-aa893e369ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630aedbe-e2ab-4488-9cf7-d036371c14c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:02 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Volume 5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1', 'volume_size': 1} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Flow 'volume_create_manager' (a77f363e-5c4f-43b1-bcf6-f02dafc75f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ec6fb7-c49f-4703-aa70-27ae02e0396d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ec6fb7-c49f-4703-aa70-27ae02e0396d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1164303684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca61e791-678f-4c79-9806-8fc15e8336ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb8be54d96c445f9f1f21515ff4f6a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:03Z,use_quota=True,user_id='4fd5bbadd2244bd8841d19ed00174ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d368e3-0ad3-451b-8c31-384be9713234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d368e3-0ad3-451b-8c31-384be9713234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a84dec-ac11-4cda-af6f-b43860f4607c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a84dec-ac11-4cda-af6f-b43860f4607c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca61e791-678f-4c79-9806-8fc15e8336ab', 'volume_name': 'volume-ca61e791-678f-4c79-9806-8fc15e8336ab', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38ca970-75ec-42b3-accb-cae4d8eff03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38ca970-75ec-42b3-accb-cae4d8eff03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a587d7c1-5550-479c-a56c-584455486786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:02 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Volume ca61e791-678f-4c79-9806-8fc15e8336ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca61e791-678f-4c79-9806-8fc15e8336ab', 'volume_size': 1} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Flow 'volume_create_manager' (82463a27-712a-4535-ab83-7b5b06ba51d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0972ff92-3cd4-448e-a89a-f3587fded787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0972ff92-3cd4-448e-a89a-f3587fded787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-368533014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c46005d3-0947-408e-aa16-37d7dc6dccbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb8be54d96c445f9f1f21515ff4f6a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:03Z,use_quota=True,user_id='4fd5bbadd2244bd8841d19ed00174ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8354a2-a28b-43ec-a761-cde6808a5224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:02 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8354a2-a28b-43ec-a761-cde6808a5224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6ec9d2-8479-4a32-918d-9b6a17456a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6ec9d2-8479-4a32-918d-9b6a17456a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c46005d3-0947-408e-aa16-37d7dc6dccbc', 'volume_name': 'volume-c46005d3-0947-408e-aa16-37d7dc6dccbc', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db6e39b-2c20-4f22-915f-e0955248516f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db6e39b-2c20-4f22-915f-e0955248516f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44387465-de62-4210-8186-2ff0d2572578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:02 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Volume c46005d3-0947-408e-aa16-37d7dc6dccbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c46005d3-0947-408e-aa16-37d7dc6dccbc', 'volume_size': 1} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ceea0206-45e6-4bac-905b-772018d76b36 1073741824" returned: 0 in 0.622s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ceea0206-45e6-4bac-905b-772018d76b36 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:02 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ceea0206-45e6-4bac-905b-772018d76b36 Apr 15 20:14:02 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Flow 'volume_create_manager' (933db973-4c36-4292-97eb-1c5d6507d88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09213d7-0bb6-40ff-81ed-43f02d2cf913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09213d7-0bb6-40ff-81ed-43f02d2cf913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1687299205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d97bdde-f40c-4aff-b288-27072db646f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb8be54d96c445f9f1f21515ff4f6a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:03Z,use_quota=True,user_id='4fd5bbadd2244bd8841d19ed00174ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91434ba1-2f04-4bc4-bfb8-248326bbfba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91434ba1-2f04-4bc4-bfb8-248326bbfba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36e2a98-d428-4f15-8a70-05cfcfe10f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36e2a98-d428-4f15-8a70-05cfcfe10f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d97bdde-f40c-4aff-b288-27072db646f8', 'volume_name': 'volume-8d97bdde-f40c-4aff-b288-27072db646f8', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d6f84c-f6c7-4771-8566-eaf13822b19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d6f84c-f6c7-4771-8566-eaf13822b19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a986dac-b770-4395-8779-a31bcc15e0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:03 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Volume 8d97bdde-f40c-4aff-b288-27072db646f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d97bdde-f40c-4aff-b288-27072db646f8', 'volume_size': 1} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:03 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ceea0206-45e6-4bac-905b-772018d76b36" returned: 0 in 0.431s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.880s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-707424046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb8be54d96c445f9f1f21515ff4f6a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:02Z,use_quota=True,user_id='4fd5bbadd2244bd8841d19ed00174ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Creating volume 5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:14:03 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c70b4f1-4a5f-4855-988a-5b61edd6a5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceea0206-45e6-4bac-905b-772018d76b36', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9195f71-0f78-4326-93ce-80d8947d9d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:03 devstack sudo[90083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1 1073741824 Apr 15 20:14:03 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:03 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Volume volume-ceea0206-45e6-4bac-905b-772018d76b36 (ceea0206-45e6-4bac-905b-772018d76b36): created successfully Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9195f71-0f78-4326-93ce-80d8947d9d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Flow 'volume_create_manager' (94ee8451-d427-4cd9-96f8-521950ddab8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:03 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-84222de4-f620-4d42-b8e5-d39ac01caf74 tempest-CreateVolumesFromImageTest-1966015585 None] Created volume successfully. Apr 15 20:14:03 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1 1073741824" returned: 0 in 0.564s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:03 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1 Apr 15 20:14:03 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:04 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1" returned: 0 in 0.455s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:14:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.732s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1164303684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca61e791-678f-4c79-9806-8fc15e8336ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb8be54d96c445f9f1f21515ff4f6a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:03Z,use_quota=True,user_id='4fd5bbadd2244bd8841d19ed00174ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:14:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Creating volume ca61e791-678f-4c79-9806-8fc15e8336ab {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:14:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:14:04 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:14:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ca61e791-678f-4c79-9806-8fc15e8336ab 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630aedbe-e2ab-4488-9cf7-d036371c14c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10281850-2d1e-4680-9aba-351fc71edee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:04 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ca61e791-678f-4c79-9806-8fc15e8336ab 1073741824 Apr 15 20:14:04 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:04 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Volume volume-5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1 (5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1): created successfully Apr 15 20:14:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10281850-2d1e-4680-9aba-351fc71edee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Flow 'volume_create_manager' (e91d380f-1d97-4c43-965a-9b0d2ccf33bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:04 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-e5e14c70-975c-4d64-8421-636cdd0f4fcb tempest-CreateVolumesFromImageTest-1966015585 None] Created volume successfully. Apr 15 20:14:04 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ca61e791-678f-4c79-9806-8fc15e8336ab 1073741824" returned: 0 in 0.485s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ca61e791-678f-4c79-9806-8fc15e8336ab {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:04 devstack sudo[90096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ca61e791-678f-4c79-9806-8fc15e8336ab Apr 15 20:14:04 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:05 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ca61e791-678f-4c79-9806-8fc15e8336ab" returned: 0 in 0.445s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:14:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.468s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-368533014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c46005d3-0947-408e-aa16-37d7dc6dccbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb8be54d96c445f9f1f21515ff4f6a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:03Z,use_quota=True,user_id='4fd5bbadd2244bd8841d19ed00174ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:14:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Creating volume c46005d3-0947-408e-aa16-37d7dc6dccbc {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:14:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:14:05 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:14:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c46005d3-0947-408e-aa16-37d7dc6dccbc 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a587d7c1-5550-479c-a56c-584455486786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca61e791-678f-4c79-9806-8fc15e8336ab', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9611dd0-ea3f-43d2-9647-4709c5dc06fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:05 devstack sudo[90099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c46005d3-0947-408e-aa16-37d7dc6dccbc 1073741824 Apr 15 20:14:05 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:05 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Volume volume-ca61e791-678f-4c79-9806-8fc15e8336ab (ca61e791-678f-4c79-9806-8fc15e8336ab): created successfully Apr 15 20:14:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9611dd0-ea3f-43d2-9647-4709c5dc06fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Flow 'volume_create_manager' (a77f363e-5c4f-43b1-bcf6-f02dafc75f4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:05 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-202d29e3-b2a2-4677-a27a-8f6eed55d2b1 tempest-CreateVolumesFromImageTest-1966015585 None] Created volume successfully. Apr 15 20:14:05 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c46005d3-0947-408e-aa16-37d7dc6dccbc 1073741824" returned: 0 in 0.481s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c46005d3-0947-408e-aa16-37d7dc6dccbc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:05 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c46005d3-0947-408e-aa16-37d7dc6dccbc Apr 15 20:14:05 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:06 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c46005d3-0947-408e-aa16-37d7dc6dccbc" returned: 0 in 0.428s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:06 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:14:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.231s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:06 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1687299205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d97bdde-f40c-4aff-b288-27072db646f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb8be54d96c445f9f1f21515ff4f6a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:03Z,use_quota=True,user_id='4fd5bbadd2244bd8841d19ed00174ab4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:14:06 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Creating volume 8d97bdde-f40c-4aff-b288-27072db646f8 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:14:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:06 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:06 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:06 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:14:06 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:14:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8d97bdde-f40c-4aff-b288-27072db646f8 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:06 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44387465-de62-4210-8186-2ff0d2572578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c46005d3-0947-408e-aa16-37d7dc6dccbc', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:06 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8d97bdde-f40c-4aff-b288-27072db646f8 1073741824 Apr 15 20:14:06 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a112eeb-ffdb-4c65-a1d0-be577dbeec33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:06 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:06 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Volume volume-c46005d3-0947-408e-aa16-37d7dc6dccbc (c46005d3-0947-408e-aa16-37d7dc6dccbc): created successfully Apr 15 20:14:06 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a112eeb-ffdb-4c65-a1d0-be577dbeec33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:06 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Flow 'volume_create_manager' (82463a27-712a-4535-ab83-7b5b06ba51d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:06 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-42aab76e-189e-4485-8a0b-5f4c4c80de0e tempest-CreateVolumesFromImageTest-1966015585 None] Created volume successfully. Apr 15 20:14:06 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8d97bdde-f40c-4aff-b288-27072db646f8 1073741824" returned: 0 in 0.461s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8d97bdde-f40c-4aff-b288-27072db646f8 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:06 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8d97bdde-f40c-4aff-b288-27072db646f8 Apr 15 20:14:06 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:07 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8d97bdde-f40c-4aff-b288-27072db646f8" returned: 0 in 0.401s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:07 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:14:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a986dac-b770-4395-8779-a31bcc15e0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d97bdde-f40c-4aff-b288-27072db646f8', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a1d2a0-7c55-4db9-b6be-bc4cd37ce6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:07 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Volume volume-8d97bdde-f40c-4aff-b288-27072db646f8 (8d97bdde-f40c-4aff-b288-27072db646f8): created successfully Apr 15 20:14:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a1d2a0-7c55-4db9-b6be-bc4cd37ce6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:07 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Flow 'volume_create_manager' (933db973-4c36-4292-97eb-1c5d6507d88b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:07 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-796ef0a0-8c43-4674-a33d-fc513653a55b tempest-CreateVolumesFromImageTest-1966015585 None] Created volume successfully. Apr 15 20:14:07 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-52bf1c48-4383-4f92-ab1c-e79163e39bbf tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "cinder-8d97bdde-f40c-4aff-b288-27072db646f8-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:07 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-52bf1c48-4383-4f92-ab1c-e79163e39bbf tempest-CreateVolumesFromImageTest-1966015585 None] Lock "cinder-8d97bdde-f40c-4aff-b288-27072db646f8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:07 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-52bf1c48-4383-4f92-ab1c-e79163e39bbf tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "cinder-quobyte-8d97bdde-f40c-4aff-b288-27072db646f8" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:07 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-52bf1c48-4383-4f92-ab1c-e79163e39bbf tempest-CreateVolumesFromImageTest-1966015585 None] Lock "cinder-quobyte-8d97bdde-f40c-4aff-b288-27072db646f8" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:07 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[b675d092-9d09-4f9d-9720-7f0bd68d5c8a]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-52bf1c48-4383-4f92-ab1c-e79163e39bbf tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8d97bdde-f40c-4aff-b288-27072db646f8 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:07 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8d97bdde-f40c-4aff-b288-27072db646f8 Apr 15 20:14:07 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:07 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-52bf1c48-4383-4f92-ab1c-e79163e39bbf tempest-CreateVolumesFromImageTest-1966015585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8d97bdde-f40c-4aff-b288-27072db646f8" returned: 0 in 0.460s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-52bf1c48-4383-4f92-ab1c-e79163e39bbf tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8d97bdde-f40c-4aff-b288-27072db646f8 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:07 devstack sudo[90120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8d97bdde-f40c-4aff-b288-27072db646f8 Apr 15 20:14:07 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:08 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-52bf1c48-4383-4f92-ab1c-e79163e39bbf tempest-CreateVolumesFromImageTest-1966015585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8d97bdde-f40c-4aff-b288-27072db646f8" returned: 0 in 0.394s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:08 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-52bf1c48-4383-4f92-ab1c-e79163e39bbf tempest-CreateVolumesFromImageTest-1966015585 None] Lock "cinder-quobyte-8d97bdde-f40c-4aff-b288-27072db646f8" released by "delete_volume" :: held 0.877s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:08 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-52bf1c48-4383-4f92-ab1c-e79163e39bbf tempest-CreateVolumesFromImageTest-1966015585 None] Created reservations ['eab0e704-843c-4374-a516-2e52d9890f33', '15d195e9-def8-4a75-a8ac-49bb143aacb9', '09aaca76-6cdb-4419-b786-028046230a5c', '846a5e7b-107a-4fde-8c48-80eff685f640'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:14:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-52bf1c48-4383-4f92-ab1c-e79163e39bbf tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-52bf1c48-4383-4f92-ab1c-e79163e39bbf tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:08 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-52bf1c48-4383-4f92-ab1c-e79163e39bbf tempest-CreateVolumesFromImageTest-1966015585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:08 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-52bf1c48-4383-4f92-ab1c-e79163e39bbf tempest-CreateVolumesFromImageTest-1966015585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-52bf1c48-4383-4f92-ab1c-e79163e39bbf tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-52bf1c48-4383-4f92-ab1c-e79163e39bbf tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:08 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:14:08 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:08 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-38185f15-580e-4503-a60d-b237000d885d tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "cinder-c46005d3-0947-408e-aa16-37d7dc6dccbc-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:08 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-38185f15-580e-4503-a60d-b237000d885d tempest-CreateVolumesFromImageTest-1966015585 None] Lock "cinder-c46005d3-0947-408e-aa16-37d7dc6dccbc-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:08 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-38185f15-580e-4503-a60d-b237000d885d tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "cinder-quobyte-c46005d3-0947-408e-aa16-37d7dc6dccbc" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:08 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-38185f15-580e-4503-a60d-b237000d885d tempest-CreateVolumesFromImageTest-1966015585 None] Lock "cinder-quobyte-c46005d3-0947-408e-aa16-37d7dc6dccbc" acquired by "delete_volume" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:08 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1b1eca-50b3-44d5-88a6-c1000e31e363]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-38185f15-580e-4503-a60d-b237000d885d tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c46005d3-0947-408e-aa16-37d7dc6dccbc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:08 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c46005d3-0947-408e-aa16-37d7dc6dccbc Apr 15 20:14:08 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:08 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-52bf1c48-4383-4f92-ab1c-e79163e39bbf tempest-CreateVolumesFromImageTest-1966015585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.431s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:08 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-52bf1c48-4383-4f92-ab1c-e79163e39bbf tempest-CreateVolumesFromImageTest-1966015585 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:14:08 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-52bf1c48-4383-4f92-ab1c-e79163e39bbf tempest-CreateVolumesFromImageTest-1966015585 None] Deleted volume successfully. Apr 15 20:14:08 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-52bf1c48-4383-4f92-ab1c-e79163e39bbf tempest-CreateVolumesFromImageTest-1966015585 None] Lock "cinder-8d97bdde-f40c-4aff-b288-27072db646f8-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:09 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-38185f15-580e-4503-a60d-b237000d885d tempest-CreateVolumesFromImageTest-1966015585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c46005d3-0947-408e-aa16-37d7dc6dccbc" returned: 0 in 0.515s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-38185f15-580e-4503-a60d-b237000d885d tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c46005d3-0947-408e-aa16-37d7dc6dccbc {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:09 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c46005d3-0947-408e-aa16-37d7dc6dccbc Apr 15 20:14:09 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:09 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-38185f15-580e-4503-a60d-b237000d885d tempest-CreateVolumesFromImageTest-1966015585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c46005d3-0947-408e-aa16-37d7dc6dccbc" returned: 0 in 0.409s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:09 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-38185f15-580e-4503-a60d-b237000d885d tempest-CreateVolumesFromImageTest-1966015585 None] Lock "cinder-quobyte-c46005d3-0947-408e-aa16-37d7dc6dccbc" released by "delete_volume" :: held 0.948s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:09 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-38185f15-580e-4503-a60d-b237000d885d tempest-CreateVolumesFromImageTest-1966015585 None] Created reservations ['e2da5cb2-031c-4992-bb0b-90b952e896b1', '0eb61154-8ee8-41db-925e-2b463a8666a3', '0d94f0af-ec65-40a6-9363-1e6d0d547eab', '405b3282-a900-4f9a-9588-c0bd90224c4c'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:14:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-38185f15-580e-4503-a60d-b237000d885d tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-38185f15-580e-4503-a60d-b237000d885d tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-38185f15-580e-4503-a60d-b237000d885d tempest-CreateVolumesFromImageTest-1966015585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-38185f15-580e-4503-a60d-b237000d885d tempest-CreateVolumesFromImageTest-1966015585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-38185f15-580e-4503-a60d-b237000d885d tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-38185f15-580e-4503-a60d-b237000d885d tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:09 devstack sudo[90168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:14:09 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:09 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cf6de318-c2a3-4652-9171-91565956d6f5 tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "cinder-ca61e791-678f-4c79-9806-8fc15e8336ab-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:09 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cf6de318-c2a3-4652-9171-91565956d6f5 tempest-CreateVolumesFromImageTest-1966015585 None] Lock "cinder-ca61e791-678f-4c79-9806-8fc15e8336ab-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:09 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cf6de318-c2a3-4652-9171-91565956d6f5 tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "cinder-quobyte-ca61e791-678f-4c79-9806-8fc15e8336ab" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:09 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cf6de318-c2a3-4652-9171-91565956d6f5 tempest-CreateVolumesFromImageTest-1966015585 None] Lock "cinder-quobyte-ca61e791-678f-4c79-9806-8fc15e8336ab" acquired by "delete_volume" :: waited 0.017s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:09 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5e3727-2e22-4d7c-a38b-8a764214f97d]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cf6de318-c2a3-4652-9171-91565956d6f5 tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ca61e791-678f-4c79-9806-8fc15e8336ab {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:09 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ca61e791-678f-4c79-9806-8fc15e8336ab Apr 15 20:14:09 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:10 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-38185f15-580e-4503-a60d-b237000d885d tempest-CreateVolumesFromImageTest-1966015585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.446s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:10 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-38185f15-580e-4503-a60d-b237000d885d tempest-CreateVolumesFromImageTest-1966015585 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:14:10 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-38185f15-580e-4503-a60d-b237000d885d tempest-CreateVolumesFromImageTest-1966015585 None] Deleted volume successfully. Apr 15 20:14:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-38185f15-580e-4503-a60d-b237000d885d tempest-CreateVolumesFromImageTest-1966015585 None] Lock "cinder-c46005d3-0947-408e-aa16-37d7dc6dccbc-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:10 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cf6de318-c2a3-4652-9171-91565956d6f5 tempest-CreateVolumesFromImageTest-1966015585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ca61e791-678f-4c79-9806-8fc15e8336ab" returned: 0 in 0.500s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cf6de318-c2a3-4652-9171-91565956d6f5 tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ca61e791-678f-4c79-9806-8fc15e8336ab {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:10 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ca61e791-678f-4c79-9806-8fc15e8336ab Apr 15 20:14:10 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:10 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cf6de318-c2a3-4652-9171-91565956d6f5 tempest-CreateVolumesFromImageTest-1966015585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ca61e791-678f-4c79-9806-8fc15e8336ab" returned: 0 in 0.422s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cf6de318-c2a3-4652-9171-91565956d6f5 tempest-CreateVolumesFromImageTest-1966015585 None] Lock "cinder-quobyte-ca61e791-678f-4c79-9806-8fc15e8336ab" released by "delete_volume" :: held 0.945s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:10 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-cf6de318-c2a3-4652-9171-91565956d6f5 tempest-CreateVolumesFromImageTest-1966015585 None] Created reservations ['85c04291-009c-4364-a2a4-eb2e78b89744', 'abf248ec-3b4d-4c5a-b5d2-96ab208d2d98', 'd7ea11b5-ee60-4051-a0dc-48ec762943e1', '90d67f65-70f9-4a74-bce3-f943d63fe6d3'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:14:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cf6de318-c2a3-4652-9171-91565956d6f5 tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cf6de318-c2a3-4652-9171-91565956d6f5 tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:10 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-cf6de318-c2a3-4652-9171-91565956d6f5 tempest-CreateVolumesFromImageTest-1966015585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:10 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-cf6de318-c2a3-4652-9171-91565956d6f5 tempest-CreateVolumesFromImageTest-1966015585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cf6de318-c2a3-4652-9171-91565956d6f5 tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cf6de318-c2a3-4652-9171-91565956d6f5 tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:10 devstack sudo[90179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:14:10 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3740b831-8745-40f3-af9c-bbc411579749 tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "cinder-5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3740b831-8745-40f3-af9c-bbc411579749 tempest-CreateVolumesFromImageTest-1966015585 None] Lock "cinder-5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3740b831-8745-40f3-af9c-bbc411579749 tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "cinder-quobyte-5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3740b831-8745-40f3-af9c-bbc411579749 tempest-CreateVolumesFromImageTest-1966015585 None] Lock "cinder-quobyte-5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1" acquired by "delete_volume" :: waited 0.016s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:10 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[57953b3e-cbba-4845-b087-e7e194a319e2]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3740b831-8745-40f3-af9c-bbc411579749 tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:10 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1 Apr 15 20:14:10 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:11 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cf6de318-c2a3-4652-9171-91565956d6f5 tempest-CreateVolumesFromImageTest-1966015585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.441s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:11 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-cf6de318-c2a3-4652-9171-91565956d6f5 tempest-CreateVolumesFromImageTest-1966015585 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:14:11 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-cf6de318-c2a3-4652-9171-91565956d6f5 tempest-CreateVolumesFromImageTest-1966015585 None] Deleted volume successfully. Apr 15 20:14:11 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cf6de318-c2a3-4652-9171-91565956d6f5 tempest-CreateVolumesFromImageTest-1966015585 None] Lock "cinder-ca61e791-678f-4c79-9806-8fc15e8336ab-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:11 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3740b831-8745-40f3-af9c-bbc411579749 tempest-CreateVolumesFromImageTest-1966015585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1" returned: 0 in 0.471s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3740b831-8745-40f3-af9c-bbc411579749 tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:11 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1 Apr 15 20:14:11 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:11 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3740b831-8745-40f3-af9c-bbc411579749 tempest-CreateVolumesFromImageTest-1966015585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1" returned: 0 in 0.380s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:11 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3740b831-8745-40f3-af9c-bbc411579749 tempest-CreateVolumesFromImageTest-1966015585 None] Lock "cinder-quobyte-5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1" released by "delete_volume" :: held 0.872s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:11 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-3740b831-8745-40f3-af9c-bbc411579749 tempest-CreateVolumesFromImageTest-1966015585 None] Created reservations ['60f26bba-2067-437d-a545-cf696b572a57', 'b0c6022c-98f3-4ac0-ae14-8a6cccea1833', '6ac56373-90e9-4ec7-8dff-9ca521c6a29c', '01d3c2a7-7c5a-47cb-8f53-5d4b688bd15a'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:14:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3740b831-8745-40f3-af9c-bbc411579749 tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3740b831-8745-40f3-af9c-bbc411579749 tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:11 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3740b831-8745-40f3-af9c-bbc411579749 tempest-CreateVolumesFromImageTest-1966015585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:11 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3740b831-8745-40f3-af9c-bbc411579749 tempest-CreateVolumesFromImageTest-1966015585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3740b831-8745-40f3-af9c-bbc411579749 tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3740b831-8745-40f3-af9c-bbc411579749 tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:11 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:14:11 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:11 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1794b428-161e-4483-933d-eed3f7d069de tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "cinder-ceea0206-45e6-4bac-905b-772018d76b36-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:11 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1794b428-161e-4483-933d-eed3f7d069de tempest-CreateVolumesFromImageTest-1966015585 None] Lock "cinder-ceea0206-45e6-4bac-905b-772018d76b36-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:12 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1794b428-161e-4483-933d-eed3f7d069de tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "cinder-quobyte-ceea0206-45e6-4bac-905b-772018d76b36" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:12 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1794b428-161e-4483-933d-eed3f7d069de tempest-CreateVolumesFromImageTest-1966015585 None] Lock "cinder-quobyte-ceea0206-45e6-4bac-905b-772018d76b36" acquired by "delete_volume" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:12 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca282382-60e0-4c11-99b0-341103b53ba8]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1794b428-161e-4483-933d-eed3f7d069de tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ceea0206-45e6-4bac-905b-772018d76b36 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:12 devstack sudo[90192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ceea0206-45e6-4bac-905b-772018d76b36 Apr 15 20:14:12 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:12 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3740b831-8745-40f3-af9c-bbc411579749 tempest-CreateVolumesFromImageTest-1966015585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.428s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:12 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-3740b831-8745-40f3-af9c-bbc411579749 tempest-CreateVolumesFromImageTest-1966015585 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:14:12 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-3740b831-8745-40f3-af9c-bbc411579749 tempest-CreateVolumesFromImageTest-1966015585 None] Deleted volume successfully. Apr 15 20:14:12 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-3740b831-8745-40f3-af9c-bbc411579749 tempest-CreateVolumesFromImageTest-1966015585 None] Lock "cinder-5c50b68d-1f18-44ee-9ec1-4d5ad8a7b4d1-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:12 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1794b428-161e-4483-933d-eed3f7d069de tempest-CreateVolumesFromImageTest-1966015585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ceea0206-45e6-4bac-905b-772018d76b36" returned: 0 in 0.467s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1794b428-161e-4483-933d-eed3f7d069de tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ceea0206-45e6-4bac-905b-772018d76b36 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:12 devstack sudo[90199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ceea0206-45e6-4bac-905b-772018d76b36 Apr 15 20:14:12 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:12 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1794b428-161e-4483-933d-eed3f7d069de tempest-CreateVolumesFromImageTest-1966015585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ceea0206-45e6-4bac-905b-772018d76b36" returned: 0 in 0.389s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:12 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1794b428-161e-4483-933d-eed3f7d069de tempest-CreateVolumesFromImageTest-1966015585 None] Lock "cinder-quobyte-ceea0206-45e6-4bac-905b-772018d76b36" released by "delete_volume" :: held 0.875s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:12 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-1794b428-161e-4483-933d-eed3f7d069de tempest-CreateVolumesFromImageTest-1966015585 None] Created reservations ['7c3f3368-def6-4df7-912f-8a4274d38ac4', '8d03c5a9-eafe-40cb-9c95-91daab591230', '9b312962-150d-4787-95d4-e8c399442a52', '00813230-9f79-4211-8055-900fe1431274'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:14:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1794b428-161e-4483-933d-eed3f7d069de tempest-CreateVolumesFromImageTest-1966015585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1794b428-161e-4483-933d-eed3f7d069de tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:12 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1794b428-161e-4483-933d-eed3f7d069de tempest-CreateVolumesFromImageTest-1966015585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:12 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1794b428-161e-4483-933d-eed3f7d069de tempest-CreateVolumesFromImageTest-1966015585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1794b428-161e-4483-933d-eed3f7d069de tempest-CreateVolumesFromImageTest-1966015585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1794b428-161e-4483-933d-eed3f7d069de tempest-CreateVolumesFromImageTest-1966015585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:12 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:14:12 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:13 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1794b428-161e-4483-933d-eed3f7d069de tempest-CreateVolumesFromImageTest-1966015585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.432s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:13 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-1794b428-161e-4483-933d-eed3f7d069de tempest-CreateVolumesFromImageTest-1966015585 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:14:13 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-1794b428-161e-4483-933d-eed3f7d069de tempest-CreateVolumesFromImageTest-1966015585 None] Deleted volume successfully. Apr 15 20:14:13 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1794b428-161e-4483-933d-eed3f7d069de tempest-CreateVolumesFromImageTest-1966015585 None] Lock "cinder-ceea0206-45e6-4bac-905b-772018d76b36-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:14 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Flow 'volume_create_manager' (82084522-8206-47b0-8ab2-286b28a09949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46b7492-b164-472b-96b8-14678ebe3a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46b7492-b164-472b-96b8-14678ebe3a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1941688977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e86c37f-f1c6-4642-87ec-077c798988bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186bd42cbd3649c9a0d19348c5a31e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:15Z,use_quota=True,user_id='450cc7d3128d44d3a8125b43a0f515d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5dca83e-0296-4901-bfeb-0b6fd0e09c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5dca83e-0296-4901-bfeb-0b6fd0e09c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4383338a-d728-44a4-b0e5-6fbb7bf28227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4383338a-d728-44a4-b0e5-6fbb7bf28227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e86c37f-f1c6-4642-87ec-077c798988bf', 'volume_name': 'volume-8e86c37f-f1c6-4642-87ec-077c798988bf', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef864aa9-4acb-4d44-9567-e13c9729b46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef864aa9-4acb-4d44-9567-e13c9729b46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:14 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0126395-9e7c-46d0-bbd6-2877ca27157a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:14 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Volume 8e86c37f-f1c6-4642-87ec-077c798988bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e86c37f-f1c6-4642-87ec-077c798988bf', 'volume_size': 1} Apr 15 20:14:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1941688977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e86c37f-f1c6-4642-87ec-077c798988bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186bd42cbd3649c9a0d19348c5a31e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:15Z,use_quota=True,user_id='450cc7d3128d44d3a8125b43a0f515d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:14:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Creating volume 8e86c37f-f1c6-4642-87ec-077c798988bf {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:14:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:14:14 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:14:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:14 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf 1073741824 Apr 15 20:14:14 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:15 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf 1073741824" returned: 0 in 0.451s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:15 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf Apr 15 20:14:15 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:15 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf" returned: 0 in 0.401s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:14:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0126395-9e7c-46d0-bbd6-2877ca27157a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e86c37f-f1c6-4642-87ec-077c798988bf', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b07c465-b033-42db-8e4d-ac6049101625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:15 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Volume volume-8e86c37f-f1c6-4642-87ec-077c798988bf (8e86c37f-f1c6-4642-87ec-077c798988bf): created successfully Apr 15 20:14:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b07c465-b033-42db-8e4d-ac6049101625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Flow 'volume_create_manager' (82084522-8206-47b0-8ab2-286b28a09949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:15 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-72f18c9d-54f5-4b05-a246-72866107b849 tempest-CreateVolumesFromSnapshotTest-941203888 None] Created volume successfully. Apr 15 20:14:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-25997f48-c8b6-453d-8453-b0bc4647fd46 tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-25997f48-c8b6-453d-8453-b0bc4647fd46 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-25997f48-c8b6-453d-8453-b0bc4647fd46 tempest-CreateVolumesFromSnapshotTest-941203888 None] Creating offline snapshot 69d035df-f5c4-43fd-99b1-27aabf364ec8 of volume 8e86c37f-f1c6-4642-87ec-077c798988bf {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:14:15 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[040b4e21-7107-4119-8b9d-ed112f7c938f]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-25997f48-c8b6-453d-8453-b0bc4647fd46 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:15 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf Apr 15 20:14:15 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:16 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-25997f48-c8b6-453d-8453-b0bc4647fd46 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf" returned: 0 in 0.460s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-25997f48-c8b6-453d-8453-b0bc4647fd46 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.69d035df-f5c4-43fd-99b1-27aabf364ec8 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:16 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.69d035df-f5c4-43fd-99b1-27aabf364ec8 1G Apr 15 20:14:16 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:16 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-25997f48-c8b6-453d-8453-b0bc4647fd46 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.69d035df-f5c4-43fd-99b1-27aabf364ec8 1G" returned: 0 in 0.438s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-25997f48-c8b6-453d-8453-b0bc4647fd46 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e86c37f-f1c6-4642-87ec-077c798988bf -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.69d035df-f5c4-43fd-99b1-27aabf364ec8 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:16 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e86c37f-f1c6-4642-87ec-077c798988bf -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.69d035df-f5c4-43fd-99b1-27aabf364ec8 Apr 15 20:14:16 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:17 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-25997f48-c8b6-453d-8453-b0bc4647fd46 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e86c37f-f1c6-4642-87ec-077c798988bf -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.69d035df-f5c4-43fd-99b1-27aabf364ec8" returned: 0 in 0.396s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:17 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-25997f48-c8b6-453d-8453-b0bc4647fd46 tempest-CreateVolumesFromSnapshotTest-941203888 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.69d035df-f5c4-43fd-99b1-27aabf364ec8 is being set with open permissions: ugo+rw Apr 15 20:14:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-25997f48-c8b6-453d-8453-b0bc4647fd46 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.69d035df-f5c4-43fd-99b1-27aabf364ec8 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:17 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.69d035df-f5c4-43fd-99b1-27aabf364ec8 Apr 15 20:14:17 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:17 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-25997f48-c8b6-453d-8453-b0bc4647fd46 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.69d035df-f5c4-43fd-99b1-27aabf364ec8" returned: 0 in 0.378s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-25997f48-c8b6-453d-8453-b0bc4647fd46 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:17 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.info Apr 15 20:14:17 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:17 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-25997f48-c8b6-453d-8453-b0bc4647fd46 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.info" returned: 0 in 0.395s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:17 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-25997f48-c8b6-453d-8453-b0bc4647fd46 tempest-CreateVolumesFromSnapshotTest-941203888 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.info is being set with open permissions: ugo+rw Apr 15 20:14:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-25997f48-c8b6-453d-8453-b0bc4647fd46 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:17 devstack sudo[90236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.info Apr 15 20:14:17 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:18 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-25997f48-c8b6-453d-8453-b0bc4647fd46 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.info" returned: 0 in 0.382s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-25997f48-c8b6-453d-8453-b0bc4647fd46 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.501s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:18 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-25997f48-c8b6-453d-8453-b0bc4647fd46 tempest-CreateVolumesFromSnapshotTest-941203888 None] Create snapshot completed successfully Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Flow 'volume_create_manager' (01dcedcf-2df7-4b56-8e10-b9abe55dfb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f9f4ab-d1b2-4899-89e8-b0000122703f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f9f4ab-d1b2-4899-89e8-b0000122703f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1246420210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b2df70c-77f3-4e15-8d7f-d894ffc7905f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186bd42cbd3649c9a0d19348c5a31e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:19Z,use_quota=True,user_id='450cc7d3128d44d3a8125b43a0f515d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5aca684-3852-46c1-a854-fb5457ecf359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5aca684-3852-46c1-a854-fb5457ecf359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466fc8bd-999d-4a69-87a0-89d737eee9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466fc8bd-999d-4a69-87a0-89d737eee9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b2df70c-77f3-4e15-8d7f-d894ffc7905f', 'volume_name': 'volume-1b2df70c-77f3-4e15-8d7f-d894ffc7905f', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3eed65-3932-400d-bd8b-07b9e7609076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3eed65-3932-400d-bd8b-07b9e7609076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402c8d2f-2844-4189-9df8-657aa308c7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:19 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Volume 1b2df70c-77f3-4e15-8d7f-d894ffc7905f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b2df70c-77f3-4e15-8d7f-d894ffc7905f', 'volume_size': 1} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1246420210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b2df70c-77f3-4e15-8d7f-d894ffc7905f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186bd42cbd3649c9a0d19348c5a31e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:19Z,use_quota=True,user_id='450cc7d3128d44d3a8125b43a0f515d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Creating volume 1b2df70c-77f3-4e15-8d7f-d894ffc7905f {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:14:19 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1b2df70c-77f3-4e15-8d7f-d894ffc7905f 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:19 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1b2df70c-77f3-4e15-8d7f-d894ffc7905f 1073741824 Apr 15 20:14:19 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Flow 'volume_create_manager' (eade44b7-852a-42d4-9960-9058b4b9673c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6c9cd6-a82d-4207-ab70-fd8461e8fb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6c9cd6-a82d-4207-ab70-fd8461e8fb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1379384335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186bd42cbd3649c9a0d19348c5a31e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:19Z,use_quota=True,user_id='450cc7d3128d44d3a8125b43a0f515d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13eb8af5-982b-43fa-9ea9-688b5e982a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13eb8af5-982b-43fa-9ea9-688b5e982a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (176f2d3a-e2e9-4796-b4cd-fa60c0d0448c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (176f2d3a-e2e9-4796-b4cd-fa60c0d0448c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519', 'volume_name': 'volume-fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f25f3c-d30f-46cc-9143-54f4a54feeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f25f3c-d30f-46cc-9143-54f4a54feeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a407e1-16d2-4fd8-b32e-764e581bed58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:19 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Volume fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519', 'volume_size': 1} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Flow 'volume_create_manager' (d7072836-84a4-4085-9964-7d18bd0228d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90bea62d-d3a0-49aa-9079-e50bd8b1d2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90bea62d-d3a0-49aa-9079-e50bd8b1d2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1573238254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8d55c4-1e33-4f8b-b249-ee2f56b48f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186bd42cbd3649c9a0d19348c5a31e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:20Z,use_quota=True,user_id='450cc7d3128d44d3a8125b43a0f515d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ceb98c5-464e-4fed-b4d9-50fd4f47b363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ceb98c5-464e-4fed-b4d9-50fd4f47b363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42bdbd0b-f7a0-44a1-8e48-bcc778c38c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42bdbd0b-f7a0-44a1-8e48-bcc778c38c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c8d55c4-1e33-4f8b-b249-ee2f56b48f36', 'volume_name': 'volume-1c8d55c4-1e33-4f8b-b249-ee2f56b48f36', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b067ac-8977-406d-82fe-57312aacafdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b067ac-8977-406d-82fe-57312aacafdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5990307-3392-4392-ab73-7cd827e5e347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:19 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Volume 1c8d55c4-1e33-4f8b-b249-ee2f56b48f36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c8d55c4-1e33-4f8b-b249-ee2f56b48f36', 'volume_size': 1} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Flow 'volume_create_manager' (44a7ac5c-aeb1-4880-a1b7-003fcee4b026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667c28ae-47e0-4130-a8ba-ce7adfd83b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:19 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667c28ae-47e0-4130-a8ba-ce7adfd83b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-165482976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9e468a3-ff22-43e1-90e9-4856793fb62d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186bd42cbd3649c9a0d19348c5a31e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:20Z,use_quota=True,user_id='450cc7d3128d44d3a8125b43a0f515d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f9033d-fa7d-4245-8546-8060b9eb53d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f9033d-fa7d-4245-8546-8060b9eb53d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f105a81c-8c0b-44c3-af2f-6b19ff037f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f105a81c-8c0b-44c3-af2f-6b19ff037f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9e468a3-ff22-43e1-90e9-4856793fb62d', 'volume_name': 'volume-c9e468a3-ff22-43e1-90e9-4856793fb62d', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518732ab-234c-411e-80a9-6f963d11da44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518732ab-234c-411e-80a9-6f963d11da44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3093910-7e5c-45e8-a1f8-874c7e2b1e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:19 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Volume c9e468a3-ff22-43e1-90e9-4856793fb62d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9e468a3-ff22-43e1-90e9-4856793fb62d', 'volume_size': 1} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1b2df70c-77f3-4e15-8d7f-d894ffc7905f 1073741824" returned: 0 in 0.611s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1b2df70c-77f3-4e15-8d7f-d894ffc7905f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:19 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1b2df70c-77f3-4e15-8d7f-d894ffc7905f Apr 15 20:14:19 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:19 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Flow 'volume_create_manager' (024d08c2-e200-43b7-b88d-ec9f7ed494d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f0bdeff-b28c-47da-a912-b072126562d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f0bdeff-b28c-47da-a912-b072126562d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1886492274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68188f20-f3f6-47fb-9e41-03e99896b95f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186bd42cbd3649c9a0d19348c5a31e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:20Z,use_quota=True,user_id='450cc7d3128d44d3a8125b43a0f515d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc8ed33-bf88-4c65-b3e0-8106baf04a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc8ed33-bf88-4c65-b3e0-8106baf04a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edd11dc-8cc1-4d7b-b15f-aa641c7e336c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edd11dc-8cc1-4d7b-b15f-aa641c7e336c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68188f20-f3f6-47fb-9e41-03e99896b95f', 'volume_name': 'volume-68188f20-f3f6-47fb-9e41-03e99896b95f', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae4a4e4-772a-484b-a65e-8672baa9c970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae4a4e4-772a-484b-a65e-8672baa9c970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7715bbf8-9e06-476a-b2a0-9f5aa00f9bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:20 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Volume 68188f20-f3f6-47fb-9e41-03e99896b95f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68188f20-f3f6-47fb-9e41-03e99896b95f', 'volume_size': 1} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:20 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1b2df70c-77f3-4e15-8d7f-d894ffc7905f" returned: 0 in 0.415s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.805s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1379384335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186bd42cbd3649c9a0d19348c5a31e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:19Z,use_quota=True,user_id='450cc7d3128d44d3a8125b43a0f515d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Creating volume fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:14:20 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402c8d2f-2844-4189-9df8-657aa308c7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b2df70c-77f3-4e15-8d7f-d894ffc7905f', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:20 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519 1073741824 Apr 15 20:14:20 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4950681-e95b-4436-b77a-baa679c2d45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:20 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Volume volume-1b2df70c-77f3-4e15-8d7f-d894ffc7905f (1b2df70c-77f3-4e15-8d7f-d894ffc7905f): created successfully Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4950681-e95b-4436-b77a-baa679c2d45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Flow 'volume_create_manager' (01dcedcf-2df7-4b56-8e10-b9abe55dfb5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:20 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-f404bc6c-62a3-468c-8b9b-9437c78542f3 tempest-CreateVolumesFromSnapshotTest-941203888 None] Created volume successfully. Apr 15 20:14:20 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519 1073741824" returned: 0 in 0.489s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:20 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519 Apr 15 20:14:20 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:21 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519" returned: 0 in 0.405s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:14:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.537s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1573238254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8d55c4-1e33-4f8b-b249-ee2f56b48f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186bd42cbd3649c9a0d19348c5a31e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:20Z,use_quota=True,user_id='450cc7d3128d44d3a8125b43a0f515d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:14:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Creating volume 1c8d55c4-1e33-4f8b-b249-ee2f56b48f36 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:14:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:14:21 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:14:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1c8d55c4-1e33-4f8b-b249-ee2f56b48f36 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a407e1-16d2-4fd8-b32e-764e581bed58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:21 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1c8d55c4-1e33-4f8b-b249-ee2f56b48f36 1073741824 Apr 15 20:14:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8bee61-d26d-4c75-a272-a89bf0808f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:21 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:21 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Volume volume-fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519 (fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519): created successfully Apr 15 20:14:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8bee61-d26d-4c75-a272-a89bf0808f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Flow 'volume_create_manager' (eade44b7-852a-42d4-9960-9058b4b9673c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:21 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-02774ef7-4e65-423f-91d0-c5e64b3044f9 tempest-CreateVolumesFromSnapshotTest-941203888 None] Created volume successfully. Apr 15 20:14:21 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1c8d55c4-1e33-4f8b-b249-ee2f56b48f36 1073741824" returned: 0 in 0.463s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:21 devstack cinder-volume[82989]: DEBUG dbcounter [-] [82989] Writing DB stats cinder:UPDATE=196,cinder:SELECT=152,cinder:DELETE=10,cinder:INSERT=47 {{(pid=82989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:14:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1c8d55c4-1e33-4f8b-b249-ee2f56b48f36 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:21 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1c8d55c4-1e33-4f8b-b249-ee2f56b48f36 Apr 15 20:14:21 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:22 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1c8d55c4-1e33-4f8b-b249-ee2f56b48f36" returned: 0 in 0.386s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.242s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-165482976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9e468a3-ff22-43e1-90e9-4856793fb62d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186bd42cbd3649c9a0d19348c5a31e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:20Z,use_quota=True,user_id='450cc7d3128d44d3a8125b43a0f515d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Creating volume c9e468a3-ff22-43e1-90e9-4856793fb62d {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:14:22 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c9e468a3-ff22-43e1-90e9-4856793fb62d 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5990307-3392-4392-ab73-7cd827e5e347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c8d55c4-1e33-4f8b-b249-ee2f56b48f36', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:22 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c9e468a3-ff22-43e1-90e9-4856793fb62d 1073741824 Apr 15 20:14:22 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a39425b4-4e76-4beb-afcf-6beef98c7097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:22 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Volume volume-1c8d55c4-1e33-4f8b-b249-ee2f56b48f36 (1c8d55c4-1e33-4f8b-b249-ee2f56b48f36): created successfully Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a39425b4-4e76-4beb-afcf-6beef98c7097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Flow 'volume_create_manager' (d7072836-84a4-4085-9964-7d18bd0228d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:22 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-fb191a35-5354-4fc7-9686-9ad7d44f01bc tempest-CreateVolumesFromSnapshotTest-941203888 None] Created volume successfully. Apr 15 20:14:22 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c9e468a3-ff22-43e1-90e9-4856793fb62d 1073741824" returned: 0 in 0.455s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c9e468a3-ff22-43e1-90e9-4856793fb62d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:22 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c9e468a3-ff22-43e1-90e9-4856793fb62d Apr 15 20:14:22 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:22 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c9e468a3-ff22-43e1-90e9-4856793fb62d" returned: 0 in 0.387s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.929s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1886492274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68188f20-f3f6-47fb-9e41-03e99896b95f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186bd42cbd3649c9a0d19348c5a31e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:20Z,use_quota=True,user_id='450cc7d3128d44d3a8125b43a0f515d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Creating volume 68188f20-f3f6-47fb-9e41-03e99896b95f {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:14:22 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68188f20-f3f6-47fb-9e41-03e99896b95f 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3093910-7e5c-45e8-a1f8-874c7e2b1e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9e468a3-ff22-43e1-90e9-4856793fb62d', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:22 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68188f20-f3f6-47fb-9e41-03e99896b95f 1073741824 Apr 15 20:14:22 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a84abf-88d0-4e50-aeb3-bc3df387f69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:22 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:23 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Volume volume-c9e468a3-ff22-43e1-90e9-4856793fb62d (c9e468a3-ff22-43e1-90e9-4856793fb62d): created successfully Apr 15 20:14:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a84abf-88d0-4e50-aeb3-bc3df387f69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Flow 'volume_create_manager' (44a7ac5c-aeb1-4880-a1b7-003fcee4b026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:23 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-b75814ff-9e39-484f-a2f1-c49add9a80e0 tempest-CreateVolumesFromSnapshotTest-941203888 None] Created volume successfully. Apr 15 20:14:23 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68188f20-f3f6-47fb-9e41-03e99896b95f 1073741824" returned: 0 in 0.484s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68188f20-f3f6-47fb-9e41-03e99896b95f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:23 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68188f20-f3f6-47fb-9e41-03e99896b95f Apr 15 20:14:23 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:23 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68188f20-f3f6-47fb-9e41-03e99896b95f" returned: 0 in 0.407s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:14:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7715bbf8-9e06-476a-b2a0-9f5aa00f9bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68188f20-f3f6-47fb-9e41-03e99896b95f', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13b1e60-d102-4072-8703-9fdf856a013b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:23 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Volume volume-68188f20-f3f6-47fb-9e41-03e99896b95f (68188f20-f3f6-47fb-9e41-03e99896b95f): created successfully Apr 15 20:14:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13b1e60-d102-4072-8703-9fdf856a013b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:23 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Flow 'volume_create_manager' (024d08c2-e200-43b7-b88d-ec9f7ed494d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:23 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-2230e033-bc97-4a74-84a2-dde524baf5f7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Created volume successfully. Apr 15 20:14:24 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-31692a2a-9ac8-45b9-9184-5eb3b35facc7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "cinder-68188f20-f3f6-47fb-9e41-03e99896b95f-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:24 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-31692a2a-9ac8-45b9-9184-5eb3b35facc7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-68188f20-f3f6-47fb-9e41-03e99896b95f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:24 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-31692a2a-9ac8-45b9-9184-5eb3b35facc7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "cinder-quobyte-68188f20-f3f6-47fb-9e41-03e99896b95f" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:24 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-31692a2a-9ac8-45b9-9184-5eb3b35facc7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-quobyte-68188f20-f3f6-47fb-9e41-03e99896b95f" acquired by "delete_volume" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:24 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccb2aa1-4604-4360-9010-a10308d7f84e]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-31692a2a-9ac8-45b9-9184-5eb3b35facc7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68188f20-f3f6-47fb-9e41-03e99896b95f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:24 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68188f20-f3f6-47fb-9e41-03e99896b95f Apr 15 20:14:24 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:24 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-31692a2a-9ac8-45b9-9184-5eb3b35facc7 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68188f20-f3f6-47fb-9e41-03e99896b95f" returned: 0 in 0.455s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-31692a2a-9ac8-45b9-9184-5eb3b35facc7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68188f20-f3f6-47fb-9e41-03e99896b95f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:24 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68188f20-f3f6-47fb-9e41-03e99896b95f Apr 15 20:14:24 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:25 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-31692a2a-9ac8-45b9-9184-5eb3b35facc7 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68188f20-f3f6-47fb-9e41-03e99896b95f" returned: 0 in 0.391s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-31692a2a-9ac8-45b9-9184-5eb3b35facc7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-quobyte-68188f20-f3f6-47fb-9e41-03e99896b95f" released by "delete_volume" :: held 0.869s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:25 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-31692a2a-9ac8-45b9-9184-5eb3b35facc7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Created reservations ['33b8886f-cbb3-45bd-bbd8-e8b3a0e8756a', '539833ff-4e77-4556-91cf-1042f687a7b2', '042582da-06bc-4413-891f-c02db402f59a', 'fd796af9-0d64-488c-bad2-1d530a7fef6a'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:14:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-31692a2a-9ac8-45b9-9184-5eb3b35facc7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-31692a2a-9ac8-45b9-9184-5eb3b35facc7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:25 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-31692a2a-9ac8-45b9-9184-5eb3b35facc7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:25 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-31692a2a-9ac8-45b9-9184-5eb3b35facc7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-31692a2a-9ac8-45b9-9184-5eb3b35facc7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-31692a2a-9ac8-45b9-9184-5eb3b35facc7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:25 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:14:25 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a936495d-bd60-4334-8f20-fcac31ed3322 tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "cinder-c9e468a3-ff22-43e1-90e9-4856793fb62d-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a936495d-bd60-4334-8f20-fcac31ed3322 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-c9e468a3-ff22-43e1-90e9-4856793fb62d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a936495d-bd60-4334-8f20-fcac31ed3322 tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "cinder-quobyte-c9e468a3-ff22-43e1-90e9-4856793fb62d" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a936495d-bd60-4334-8f20-fcac31ed3322 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-quobyte-c9e468a3-ff22-43e1-90e9-4856793fb62d" acquired by "delete_volume" :: waited 0.018s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:25 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[466a941e-5752-4f6c-98e1-144e22ed1764]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a936495d-bd60-4334-8f20-fcac31ed3322 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c9e468a3-ff22-43e1-90e9-4856793fb62d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:25 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c9e468a3-ff22-43e1-90e9-4856793fb62d Apr 15 20:14:25 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:25 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-31692a2a-9ac8-45b9-9184-5eb3b35facc7 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.409s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:25 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-31692a2a-9ac8-45b9-9184-5eb3b35facc7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:14:25 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-31692a2a-9ac8-45b9-9184-5eb3b35facc7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Deleted volume successfully. Apr 15 20:14:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-31692a2a-9ac8-45b9-9184-5eb3b35facc7 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-68188f20-f3f6-47fb-9e41-03e99896b95f-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:26 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a936495d-bd60-4334-8f20-fcac31ed3322 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c9e468a3-ff22-43e1-90e9-4856793fb62d" returned: 0 in 0.473s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a936495d-bd60-4334-8f20-fcac31ed3322 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c9e468a3-ff22-43e1-90e9-4856793fb62d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:26 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c9e468a3-ff22-43e1-90e9-4856793fb62d Apr 15 20:14:26 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:26 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a936495d-bd60-4334-8f20-fcac31ed3322 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-c9e468a3-ff22-43e1-90e9-4856793fb62d" returned: 0 in 0.447s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:26 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a936495d-bd60-4334-8f20-fcac31ed3322 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-quobyte-c9e468a3-ff22-43e1-90e9-4856793fb62d" released by "delete_volume" :: held 0.940s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:26 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-a936495d-bd60-4334-8f20-fcac31ed3322 tempest-CreateVolumesFromSnapshotTest-941203888 None] Created reservations ['c60fea70-a91c-4552-8756-dd1b5f7fa843', 'af968229-2cac-413a-a846-e85f571ea180', '4b06ae25-953c-44c2-bf65-83571c717614', '4397f0c6-d733-45a9-b049-95a4a15749ff'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:14:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a936495d-bd60-4334-8f20-fcac31ed3322 tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a936495d-bd60-4334-8f20-fcac31ed3322 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:26 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-a936495d-bd60-4334-8f20-fcac31ed3322 tempest-CreateVolumesFromSnapshotTest-941203888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:26 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-a936495d-bd60-4334-8f20-fcac31ed3322 tempest-CreateVolumesFromSnapshotTest-941203888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a936495d-bd60-4334-8f20-fcac31ed3322 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a936495d-bd60-4334-8f20-fcac31ed3322 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:26 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:14:26 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:26 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-081bd2dd-48a1-486a-b045-b687fad0cf1b tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "cinder-1c8d55c4-1e33-4f8b-b249-ee2f56b48f36-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:26 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-081bd2dd-48a1-486a-b045-b687fad0cf1b tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-1c8d55c4-1e33-4f8b-b249-ee2f56b48f36-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:26 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-081bd2dd-48a1-486a-b045-b687fad0cf1b tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "cinder-quobyte-1c8d55c4-1e33-4f8b-b249-ee2f56b48f36" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:26 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-081bd2dd-48a1-486a-b045-b687fad0cf1b tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-quobyte-1c8d55c4-1e33-4f8b-b249-ee2f56b48f36" acquired by "delete_volume" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:26 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[3daf0540-47ed-4662-98e8-5a69812ccb36]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-081bd2dd-48a1-486a-b045-b687fad0cf1b tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1c8d55c4-1e33-4f8b-b249-ee2f56b48f36 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:26 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1c8d55c4-1e33-4f8b-b249-ee2f56b48f36 Apr 15 20:14:26 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:26 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a936495d-bd60-4334-8f20-fcac31ed3322 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.401s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-a936495d-bd60-4334-8f20-fcac31ed3322 tempest-CreateVolumesFromSnapshotTest-941203888 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:14:27 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-a936495d-bd60-4334-8f20-fcac31ed3322 tempest-CreateVolumesFromSnapshotTest-941203888 None] Deleted volume successfully. Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a936495d-bd60-4334-8f20-fcac31ed3322 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-c9e468a3-ff22-43e1-90e9-4856793fb62d-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:27 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-081bd2dd-48a1-486a-b045-b687fad0cf1b tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1c8d55c4-1e33-4f8b-b249-ee2f56b48f36" returned: 0 in 0.460s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-081bd2dd-48a1-486a-b045-b687fad0cf1b tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1c8d55c4-1e33-4f8b-b249-ee2f56b48f36 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:27 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1c8d55c4-1e33-4f8b-b249-ee2f56b48f36 Apr 15 20:14:27 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:27 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-081bd2dd-48a1-486a-b045-b687fad0cf1b tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1c8d55c4-1e33-4f8b-b249-ee2f56b48f36" returned: 0 in 0.383s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-081bd2dd-48a1-486a-b045-b687fad0cf1b tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-quobyte-1c8d55c4-1e33-4f8b-b249-ee2f56b48f36" released by "delete_volume" :: held 0.870s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-081bd2dd-48a1-486a-b045-b687fad0cf1b tempest-CreateVolumesFromSnapshotTest-941203888 None] Created reservations ['fc0b5bdd-9b1e-406c-81ef-8889d6f3778e', '5144384e-a9d4-4a7d-accc-7aac96457462', '6f4d9555-dca3-4789-907d-26097153b75c', 'a92f32ff-4bcb-451e-a54f-c217c2a3dbcc'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG oslo_service.periodic_task [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82989) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:27 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:14:27 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-081bd2dd-48a1-486a-b045-b687fad0cf1b tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-081bd2dd-48a1-486a-b045-b687fad0cf1b tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-081bd2dd-48a1-486a-b045-b687fad0cf1b tempest-CreateVolumesFromSnapshotTest-941203888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-081bd2dd-48a1-486a-b045-b687fad0cf1b tempest-CreateVolumesFromSnapshotTest-941203888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-081bd2dd-48a1-486a-b045-b687fad0cf1b tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-081bd2dd-48a1-486a-b045-b687fad0cf1b tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:27 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:14:27 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6a2f560b-6104-4ce3-8b85-f3258e8afadb tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "cinder-fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6a2f560b-6104-4ce3-8b85-f3258e8afadb tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6a2f560b-6104-4ce3-8b85-f3258e8afadb tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "cinder-quobyte-fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6a2f560b-6104-4ce3-8b85-f3258e8afadb tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-quobyte-fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519" acquired by "delete_volume" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[5879060a-dcf8-4688-9769-8a7c7e7cc27c]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6a2f560b-6104-4ce3-8b85-f3258e8afadb tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:27 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519 Apr 15 20:14:27 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:28 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.433s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:28 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:14:28 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-081bd2dd-48a1-486a-b045-b687fad0cf1b tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.444s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:28 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-081bd2dd-48a1-486a-b045-b687fad0cf1b tempest-CreateVolumesFromSnapshotTest-941203888 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:14:28 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-081bd2dd-48a1-486a-b045-b687fad0cf1b tempest-CreateVolumesFromSnapshotTest-941203888 None] Deleted volume successfully. Apr 15 20:14:28 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-081bd2dd-48a1-486a-b045-b687fad0cf1b tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-1c8d55c4-1e33-4f8b-b249-ee2f56b48f36-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:28 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6a2f560b-6104-4ce3-8b85-f3258e8afadb tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519" returned: 0 in 0.480s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6a2f560b-6104-4ce3-8b85-f3258e8afadb tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:28 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519 Apr 15 20:14:28 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:28 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6a2f560b-6104-4ce3-8b85-f3258e8afadb tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519" returned: 0 in 0.388s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:28 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6a2f560b-6104-4ce3-8b85-f3258e8afadb tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-quobyte-fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519" released by "delete_volume" :: held 0.886s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:28 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-6a2f560b-6104-4ce3-8b85-f3258e8afadb tempest-CreateVolumesFromSnapshotTest-941203888 None] Created reservations ['acb0d696-58c9-4362-960d-001956031d82', 'c6134084-f763-472b-89b9-6a47d9e55fb2', '408cbd41-d2ec-4d2d-bfca-742dc9436ad5', 'cd72e894-12c6-4302-b12a-3532455a32b2'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:14:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-6a2f560b-6104-4ce3-8b85-f3258e8afadb tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-6a2f560b-6104-4ce3-8b85-f3258e8afadb tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:28 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-6a2f560b-6104-4ce3-8b85-f3258e8afadb tempest-CreateVolumesFromSnapshotTest-941203888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:28 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-6a2f560b-6104-4ce3-8b85-f3258e8afadb tempest-CreateVolumesFromSnapshotTest-941203888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-6a2f560b-6104-4ce3-8b85-f3258e8afadb tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6a2f560b-6104-4ce3-8b85-f3258e8afadb tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:28 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:14:28 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:28 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-70f679e1-3e9f-4c37-8164-5e36e54d6a16 tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "cinder-1b2df70c-77f3-4e15-8d7f-d894ffc7905f-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:28 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-70f679e1-3e9f-4c37-8164-5e36e54d6a16 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-1b2df70c-77f3-4e15-8d7f-d894ffc7905f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:28 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-70f679e1-3e9f-4c37-8164-5e36e54d6a16 tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "cinder-quobyte-1b2df70c-77f3-4e15-8d7f-d894ffc7905f" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:28 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-70f679e1-3e9f-4c37-8164-5e36e54d6a16 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-quobyte-1b2df70c-77f3-4e15-8d7f-d894ffc7905f" acquired by "delete_volume" :: waited 0.019s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:28 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed458a5-36c4-4e93-8d2f-7f7e035a5bea]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-70f679e1-3e9f-4c37-8164-5e36e54d6a16 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1b2df70c-77f3-4e15-8d7f-d894ffc7905f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:29 devstack sudo[90326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1b2df70c-77f3-4e15-8d7f-d894ffc7905f Apr 15 20:14:29 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:29 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-6a2f560b-6104-4ce3-8b85-f3258e8afadb tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.412s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:29 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-6a2f560b-6104-4ce3-8b85-f3258e8afadb tempest-CreateVolumesFromSnapshotTest-941203888 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:14:29 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-6a2f560b-6104-4ce3-8b85-f3258e8afadb tempest-CreateVolumesFromSnapshotTest-941203888 None] Deleted volume successfully. Apr 15 20:14:29 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-6a2f560b-6104-4ce3-8b85-f3258e8afadb tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-fea0c0b8-2edd-4b2f-be36-f1e3a6ac1519-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:29 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-70f679e1-3e9f-4c37-8164-5e36e54d6a16 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1b2df70c-77f3-4e15-8d7f-d894ffc7905f" returned: 0 in 0.450s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-70f679e1-3e9f-4c37-8164-5e36e54d6a16 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1b2df70c-77f3-4e15-8d7f-d894ffc7905f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:29 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1b2df70c-77f3-4e15-8d7f-d894ffc7905f Apr 15 20:14:29 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:29 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-70f679e1-3e9f-4c37-8164-5e36e54d6a16 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-1b2df70c-77f3-4e15-8d7f-d894ffc7905f" returned: 0 in 0.388s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:29 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-70f679e1-3e9f-4c37-8164-5e36e54d6a16 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-quobyte-1b2df70c-77f3-4e15-8d7f-d894ffc7905f" released by "delete_volume" :: held 0.856s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:29 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-70f679e1-3e9f-4c37-8164-5e36e54d6a16 tempest-CreateVolumesFromSnapshotTest-941203888 None] Created reservations ['3a47dbd8-a0ff-4cc3-9b42-900151b0f4e7', 'd8e4ba9e-2140-4edd-a180-dd666107c6df', 'b2b0bc00-4499-41a7-a7a6-23ada67155d7', 'fbe751a4-b9e0-425d-85b4-5c1082b3adb2'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:14:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-70f679e1-3e9f-4c37-8164-5e36e54d6a16 tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-70f679e1-3e9f-4c37-8164-5e36e54d6a16 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-70f679e1-3e9f-4c37-8164-5e36e54d6a16 tempest-CreateVolumesFromSnapshotTest-941203888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:29 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-70f679e1-3e9f-4c37-8164-5e36e54d6a16 tempest-CreateVolumesFromSnapshotTest-941203888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-70f679e1-3e9f-4c37-8164-5e36e54d6a16 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-70f679e1-3e9f-4c37-8164-5e36e54d6a16 tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:29 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:14:29 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-bfdf3c3b-40af-48a8-b7c5-011276f8511c tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "cinder-69d035df-f5c4-43fd-99b1-27aabf364ec8-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-bfdf3c3b-40af-48a8-b7c5-011276f8511c tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-69d035df-f5c4-43fd-99b1-27aabf364ec8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-bfdf3c3b-40af-48a8-b7c5-011276f8511c tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "cinder-quobyte-8e86c37f-f1c6-4642-87ec-077c798988bf" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-bfdf3c3b-40af-48a8-b7c5-011276f8511c tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-quobyte-8e86c37f-f1c6-4642-87ec-077c798988bf" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-bfdf3c3b-40af-48a8-b7c5-011276f8511c tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "cinder-quobyte-69d035df-f5c4-43fd-99b1-27aabf364ec8" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-bfdf3c3b-40af-48a8-b7c5-011276f8511c tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-quobyte-69d035df-f5c4-43fd-99b1-27aabf364ec8" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-bfdf3c3b-40af-48a8-b7c5-011276f8511c tempest-CreateVolumesFromSnapshotTest-941203888 None] Deleting offline snapshot 69d035df-f5c4-43fd-99b1-27aabf364ec8 of volume 8e86c37f-f1c6-4642-87ec-077c798988bf {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:14:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-bfdf3c3b-40af-48a8-b7c5-011276f8511c tempest-CreateVolumesFromSnapshotTest-941203888 None] snapshot_file for this snap is: volume-8e86c37f-f1c6-4642-87ec-077c798988bf.69d035df-f5c4-43fd-99b1-27aabf364ec8 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:14:30 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c8684e-9b81-4ae2-bef9-32eff1ae2cb1]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bfdf3c3b-40af-48a8-b7c5-011276f8511c tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.69d035df-f5c4-43fd-99b1-27aabf364ec8 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:30 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.69d035df-f5c4-43fd-99b1-27aabf364ec8 Apr 15 20:14:30 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:30 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-70f679e1-3e9f-4c37-8164-5e36e54d6a16 tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.404s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:30 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-70f679e1-3e9f-4c37-8164-5e36e54d6a16 tempest-CreateVolumesFromSnapshotTest-941203888 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:14:30 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-70f679e1-3e9f-4c37-8164-5e36e54d6a16 tempest-CreateVolumesFromSnapshotTest-941203888 None] Deleted volume successfully. Apr 15 20:14:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-70f679e1-3e9f-4c37-8164-5e36e54d6a16 tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-1b2df70c-77f3-4e15-8d7f-d894ffc7905f-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:30 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bfdf3c3b-40af-48a8-b7c5-011276f8511c tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.69d035df-f5c4-43fd-99b1-27aabf364ec8" returned: 0 in 0.451s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-bfdf3c3b-40af-48a8-b7c5-011276f8511c tempest-CreateVolumesFromSnapshotTest-941203888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e86c37f-f1c6-4642-87ec-077c798988bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:14:30 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b4b28a-73af-45a5-b21d-e9a876555c6e]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bfdf3c3b-40af-48a8-b7c5-011276f8511c tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:30 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf Apr 15 20:14:30 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:30 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bfdf3c3b-40af-48a8-b7c5-011276f8511c tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf" returned: 0 in 0.484s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bfdf3c3b-40af-48a8-b7c5-011276f8511c tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.69d035df-f5c4-43fd-99b1-27aabf364ec8 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:31 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.69d035df-f5c4-43fd-99b1-27aabf364ec8 Apr 15 20:14:31 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:31 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bfdf3c3b-40af-48a8-b7c5-011276f8511c tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.69d035df-f5c4-43fd-99b1-27aabf364ec8" returned: 0 in 0.474s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bfdf3c3b-40af-48a8-b7c5-011276f8511c tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.69d035df-f5c4-43fd-99b1-27aabf364ec8 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:31 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.69d035df-f5c4-43fd-99b1-27aabf364ec8 Apr 15 20:14:31 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:31 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bfdf3c3b-40af-48a8-b7c5-011276f8511c tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf.69d035df-f5c4-43fd-99b1-27aabf364ec8" returned: 0 in 0.383s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:31 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-bfdf3c3b-40af-48a8-b7c5-011276f8511c tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-quobyte-69d035df-f5c4-43fd-99b1-27aabf364ec8" released by "_delete_snapshot" :: held 1.842s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:31 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-bfdf3c3b-40af-48a8-b7c5-011276f8511c tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-quobyte-8e86c37f-f1c6-4642-87ec-077c798988bf" released by "delete_snapshot" :: held 1.851s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:31 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-bfdf3c3b-40af-48a8-b7c5-011276f8511c tempest-CreateVolumesFromSnapshotTest-941203888 None] Created reservations ['bf12a791-4b83-4eb0-9c8b-c77cdbc7e8d4', '36d89608-6134-46c1-a957-58261ec7da87', 'd45b105b-aa04-4ec4-ba64-bbf78b47438c', 'fa63b77a-89f0-4080-80d9-573b0ef03545'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:14:31 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-bfdf3c3b-40af-48a8-b7c5-011276f8511c tempest-CreateVolumesFromSnapshotTest-941203888 None] Delete snapshot completed successfully. Apr 15 20:14:31 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-bfdf3c3b-40af-48a8-b7c5-011276f8511c tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-69d035df-f5c4-43fd-99b1-27aabf364ec8-delete_snapshot" released by "delete_snapshot" :: held 1.932s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cffbb94a-1151-4e53-9085-3be6ebcc054d tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "cinder-8e86c37f-f1c6-4642-87ec-077c798988bf-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cffbb94a-1151-4e53-9085-3be6ebcc054d tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-8e86c37f-f1c6-4642-87ec-077c798988bf-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cffbb94a-1151-4e53-9085-3be6ebcc054d tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "cinder-quobyte-8e86c37f-f1c6-4642-87ec-077c798988bf" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cffbb94a-1151-4e53-9085-3be6ebcc054d tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-quobyte-8e86c37f-f1c6-4642-87ec-077c798988bf" acquired by "delete_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:32 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5b33ad-4452-4feb-9acd-b68accfcd24c]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cffbb94a-1151-4e53-9085-3be6ebcc054d tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:32 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf Apr 15 20:14:32 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:32 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cffbb94a-1151-4e53-9085-3be6ebcc054d tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf" returned: 0 in 0.452s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cffbb94a-1151-4e53-9085-3be6ebcc054d tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:32 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf Apr 15 20:14:32 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:33 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cffbb94a-1151-4e53-9085-3be6ebcc054d tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8e86c37f-f1c6-4642-87ec-077c798988bf" returned: 0 in 0.402s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cffbb94a-1151-4e53-9085-3be6ebcc054d tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-quobyte-8e86c37f-f1c6-4642-87ec-077c798988bf" released by "delete_volume" :: held 0.889s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:33 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-cffbb94a-1151-4e53-9085-3be6ebcc054d tempest-CreateVolumesFromSnapshotTest-941203888 None] Created reservations ['48edde50-a60d-4c49-944c-28746617bad5', '87f69ce8-634f-4312-a3dd-57fc4cdc1697', '7399e2e2-ede0-479c-9802-d51e4e92dce8', '2c1d4131-4a5f-482b-9411-03c42b67dbaa'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:14:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cffbb94a-1151-4e53-9085-3be6ebcc054d tempest-CreateVolumesFromSnapshotTest-941203888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cffbb94a-1151-4e53-9085-3be6ebcc054d tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:33 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-cffbb94a-1151-4e53-9085-3be6ebcc054d tempest-CreateVolumesFromSnapshotTest-941203888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:33 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-cffbb94a-1151-4e53-9085-3be6ebcc054d tempest-CreateVolumesFromSnapshotTest-941203888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-cffbb94a-1151-4e53-9085-3be6ebcc054d tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cffbb94a-1151-4e53-9085-3be6ebcc054d tempest-CreateVolumesFromSnapshotTest-941203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:33 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:14:33 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:33 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-cffbb94a-1151-4e53-9085-3be6ebcc054d tempest-CreateVolumesFromSnapshotTest-941203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.455s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:33 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-cffbb94a-1151-4e53-9085-3be6ebcc054d tempest-CreateVolumesFromSnapshotTest-941203888 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:14:33 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-cffbb94a-1151-4e53-9085-3be6ebcc054d tempest-CreateVolumesFromSnapshotTest-941203888 None] Deleted volume successfully. Apr 15 20:14:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-cffbb94a-1151-4e53-9085-3be6ebcc054d tempest-CreateVolumesFromSnapshotTest-941203888 None] Lock "cinder-8e86c37f-f1c6-4642-87ec-077c798988bf-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Flow 'volume_create_manager' (4c4919a6-6491-4f83-b1f9-90f3fb681ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b56a62-cae6-4e48-8a46-38786c689069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG dbcounter [-] [82989] Writing DB stats cinder:UPDATE=185,cinder:SELECT=134,cinder:DELETE=23,cinder:INSERT=55 {{(pid=82989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b56a62-cae6-4e48-8a46-38786c689069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-399876714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc3742a-6089-4868-aa09-054aaa23e079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0340c497c824375919e0ad09d462eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:40Z,use_quota=True,user_id='5ccaa57e4c6544f79680948c294abb06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a8dfa5-7a0c-4ebe-bc79-13c5a33db0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a8dfa5-7a0c-4ebe-bc79-13c5a33db0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4dd8a6-86b2-440b-8320-95983bf82627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4dd8a6-86b2-440b-8320-95983bf82627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bc3742a-6089-4868-aa09-054aaa23e079', 'volume_name': 'volume-8bc3742a-6089-4868-aa09-054aaa23e079', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcab2929-5e00-4eb9-9016-a481eb1177e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcab2929-5e00-4eb9-9016-a481eb1177e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adacc3f9-d8c7-471f-99e5-8993463aa57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:40 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Volume 8bc3742a-6089-4868-aa09-054aaa23e079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bc3742a-6089-4868-aa09-054aaa23e079', 'volume_size': 1} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-399876714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc3742a-6089-4868-aa09-054aaa23e079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0340c497c824375919e0ad09d462eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:40Z,use_quota=True,user_id='5ccaa57e4c6544f79680948c294abb06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Creating volume 8bc3742a-6089-4868-aa09-054aaa23e079 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:14:40 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8bc3742a-6089-4868-aa09-054aaa23e079 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Flow 'volume_create_manager' (d94e236b-31a8-4f0d-8751-b55aac1074d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5bea38-ac8b-42fd-a1a6-62bd920e90cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:40 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8bc3742a-6089-4868-aa09-054aaa23e079 1073741824 Apr 15 20:14:40 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5bea38-ac8b-42fd-a1a6-62bd920e90cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1404617924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba9882e9-0897-42ce-91d5-0a9e3a78821d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca62bf5cd72487c9bc3e4103ad1e30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:40Z,use_quota=True,user_id='db99822632054502994d318bed45b069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (048f84fb-1e04-4653-9bbf-3174dde7fd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (048f84fb-1e04-4653-9bbf-3174dde7fd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b1a75b-28a4-41be-847c-bfe00a1d54c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b1a75b-28a4-41be-847c-bfe00a1d54c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba9882e9-0897-42ce-91d5-0a9e3a78821d', 'volume_name': 'volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d14417c-5076-4463-b9eb-9aa58e83aa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d14417c-5076-4463-b9eb-9aa58e83aa87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77293258-cc44-4705-9fc3-0d4837e2efb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:40 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Volume ba9882e9-0897-42ce-91d5-0a9e3a78821d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d', 'volume_size': 1} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Flow 'volume_create_manager' (28084ec4-c120-48a8-9c13-b51f26bab8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a79bb0-d759-4c16-bb33-03a0885a9ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a79bb0-d759-4c16-bb33-03a0885a9ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-732121426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c07183a-3330-4ae7-b52d-d15ee6919387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0340c497c824375919e0ad09d462eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:41Z,use_quota=True,user_id='5ccaa57e4c6544f79680948c294abb06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1343da-a481-4958-a33b-1729201d58da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1343da-a481-4958-a33b-1729201d58da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72a8399-1733-4ca7-a657-b1a831d27f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72a8399-1733-4ca7-a657-b1a831d27f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c07183a-3330-4ae7-b52d-d15ee6919387', 'volume_name': 'volume-9c07183a-3330-4ae7-b52d-d15ee6919387', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a3b472d-52ef-4109-bf39-e896a50c0d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a3b472d-52ef-4109-bf39-e896a50c0d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b52044-aa5a-4e99-ad0b-c6b338aac34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:40 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Volume 9c07183a-3330-4ae7-b52d-d15ee6919387: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c07183a-3330-4ae7-b52d-d15ee6919387', 'volume_size': 1} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Flow 'volume_create_manager' (54ab36a4-1aa7-488b-8d1d-acd079bed453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa49cbf-cd0d-46a0-92f8-edbdbe4c3062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa49cbf-cd0d-46a0-92f8-edbdbe4c3062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-21472856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da3f384-d7ab-4740-9475-99ee38739503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bca39e0b413f463ba72f63b2e3c28155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:41Z,use_quota=True,user_id='679cde384c8148fd9df4cee5c5ffb6d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d51e8fe4-c609-4eb3-9f3d-2c55c80432d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d51e8fe4-c609-4eb3-9f3d-2c55c80432d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc250b2e-186a-49dc-9ef8-be162666dbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc250b2e-186a-49dc-9ef8-be162666dbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5da3f384-d7ab-4740-9475-99ee38739503', 'volume_name': 'volume-5da3f384-d7ab-4740-9475-99ee38739503', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b250b6-3965-4ca3-8d2c-da9dd6ee6266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b250b6-3965-4ca3-8d2c-da9dd6ee6266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3ecc0f-7078-46c0-bb50-4765f546c1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:40 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Volume 5da3f384-d7ab-4740-9475-99ee38739503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5da3f384-d7ab-4740-9475-99ee38739503', 'volume_size': 1} Apr 15 20:14:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Flow 'volume_create_manager' (bda3bfcc-92e3-43be-abf5-799a5efeb1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981563da-acdf-4121-a40c-4e82a72ff5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981563da-acdf-4121-a40c-4e82a72ff5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1240939631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb2bc4a5-cc4a-475e-8a1b-be8213511e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0340c497c824375919e0ad09d462eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:41Z,use_quota=True,user_id='5ccaa57e4c6544f79680948c294abb06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff837797-f64e-4edd-9531-2786ae9504ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff837797-f64e-4edd-9531-2786ae9504ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2afafe-fa73-4703-a79a-cf38d0525a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2afafe-fa73-4703-a79a-cf38d0525a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb2bc4a5-cc4a-475e-8a1b-be8213511e78', 'volume_name': 'volume-eb2bc4a5-cc4a-475e-8a1b-be8213511e78', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ccf36e5-9e4e-4b9b-93bd-af1cd1d723cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ccf36e5-9e4e-4b9b-93bd-af1cd1d723cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6acb28-f986-4ac0-90a8-0c6b73dacf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:41 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Volume eb2bc4a5-cc4a-475e-8a1b-be8213511e78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb2bc4a5-cc4a-475e-8a1b-be8213511e78', 'volume_size': 1} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Flow 'volume_create_manager' (33706e7e-e97b-41e6-9583-0f84c6646522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85704bf-67b3-4def-8032-4c775e3baf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85704bf-67b3-4def-8032-4c775e3baf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1687369136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68bc6466-c736-4bc4-89be-20e62d25e5be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0340c497c824375919e0ad09d462eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:41Z,use_quota=True,user_id='5ccaa57e4c6544f79680948c294abb06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc29394a-b45a-4361-bbbc-fea0d98dd3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc29394a-b45a-4361-bbbc-fea0d98dd3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53bdb5f-7fae-4274-9a0b-1d38f61c4fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53bdb5f-7fae-4274-9a0b-1d38f61c4fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68bc6466-c736-4bc4-89be-20e62d25e5be', 'volume_name': 'volume-68bc6466-c736-4bc4-89be-20e62d25e5be', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c17578e7-c7ba-4df6-8d48-c9c6f6b7fc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c17578e7-c7ba-4df6-8d48-c9c6f6b7fc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945c94f5-2abd-442d-ac01-6a702077efc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:41 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Volume 68bc6466-c736-4bc4-89be-20e62d25e5be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68bc6466-c736-4bc4-89be-20e62d25e5be', 'volume_size': 1} Apr 15 20:14:41 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8bc3742a-6089-4868-aa09-054aaa23e079 1073741824" returned: 0 in 0.748s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8bc3742a-6089-4868-aa09-054aaa23e079 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:41 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8bc3742a-6089-4868-aa09-054aaa23e079 Apr 15 20:14:41 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Flow 'volume_create_manager' (af227f64-6925-4bf2-b5e6-19d6447a3775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba7fddc-aaa8-4d36-bb5e-c4e788631119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba7fddc-aaa8-4d36-bb5e-c4e788631119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2022321750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3dfe50-3c5a-425b-acbf-5583eea6b36a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0340c497c824375919e0ad09d462eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:41Z,use_quota=True,user_id='5ccaa57e4c6544f79680948c294abb06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16cf350c-c4c0-422b-954c-b7a3bc339a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16cf350c-c4c0-422b-954c-b7a3bc339a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45539fee-fb28-42be-8df7-66735ee40ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45539fee-fb28-42be-8df7-66735ee40ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa3dfe50-3c5a-425b-acbf-5583eea6b36a', 'volume_name': 'volume-fa3dfe50-3c5a-425b-acbf-5583eea6b36a', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3335bb-c44b-4385-9711-3f7703557b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3335bb-c44b-4385-9711-3f7703557b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3367e06-75a4-4199-9c8d-171e15de4c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:41 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Volume fa3dfe50-3c5a-425b-acbf-5583eea6b36a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa3dfe50-3c5a-425b-acbf-5583eea6b36a', 'volume_size': 1} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:41 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8bc3742a-6089-4868-aa09-054aaa23e079" returned: 0 in 0.557s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.238s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1404617924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba9882e9-0897-42ce-91d5-0a9e3a78821d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca62bf5cd72487c9bc3e4103ad1e30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:40Z,use_quota=True,user_id='db99822632054502994d318bed45b069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Creating volume ba9882e9-0897-42ce-91d5-0a9e3a78821d {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:14:41 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:41 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adacc3f9-d8c7-471f-99e5-8993463aa57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bc3742a-6089-4868-aa09-054aaa23e079', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:42 devstack sudo[90418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d 1073741824 Apr 15 20:14:42 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:42 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ef5399-41b9-405e-852c-bad169cd3ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:42 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Volume volume-8bc3742a-6089-4868-aa09-054aaa23e079 (8bc3742a-6089-4868-aa09-054aaa23e079): created successfully Apr 15 20:14:42 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ef5399-41b9-405e-852c-bad169cd3ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:42 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Flow 'volume_create_manager' (4c4919a6-6491-4f83-b1f9-90f3fb681ba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:42 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-49ef1974-bcf0-4e43-8507-06c964477f31 tempest-CreateVolumesFromImageTest-2068535951 None] Created volume successfully. Apr 15 20:14:42 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d 1073741824" returned: 0 in 0.585s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:42 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:42 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d Apr 15 20:14:42 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:43 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d" returned: 0 in 0.477s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:14:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.247s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-732121426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c07183a-3330-4ae7-b52d-d15ee6919387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0340c497c824375919e0ad09d462eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:41Z,use_quota=True,user_id='5ccaa57e4c6544f79680948c294abb06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:14:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Creating volume 9c07183a-3330-4ae7-b52d-d15ee6919387 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:14:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:43 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:14:43 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:14:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-9c07183a-3330-4ae7-b52d-d15ee6919387 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77293258-cc44-4705-9fc3-0d4837e2efb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:43 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-9c07183a-3330-4ae7-b52d-d15ee6919387 1073741824 Apr 15 20:14:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9ece82-bc5d-4efc-9374-6d3ed4c439da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:43 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:43 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Volume volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d (ba9882e9-0897-42ce-91d5-0a9e3a78821d): created successfully Apr 15 20:14:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9ece82-bc5d-4efc-9374-6d3ed4c439da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:43 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Flow 'volume_create_manager' (d94e236b-31a8-4f0d-8751-b55aac1074d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:43 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-268f80b8-42cf-4f2b-843b-a99091098cd3 tempest-VolumeDependencyTests-116051424 None] Created volume successfully. Apr 15 20:14:43 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-9c07183a-3330-4ae7-b52d-d15ee6919387 1073741824" returned: 0 in 0.506s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:43 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-9c07183a-3330-4ae7-b52d-d15ee6919387 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:43 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-9c07183a-3330-4ae7-b52d-d15ee6919387 Apr 15 20:14:43 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d77af997-5a3b-4059-9836-17e95a7325b8 tempest-VolumeDependencyTests-116051424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:44 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-9c07183a-3330-4ae7-b52d-d15ee6919387" returned: 0 in 0.551s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:44 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:14:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.224s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:44 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-21472856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da3f384-d7ab-4740-9475-99ee38739503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bca39e0b413f463ba72f63b2e3c28155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:41Z,use_quota=True,user_id='679cde384c8148fd9df4cee5c5ffb6d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:14:44 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Creating volume 5da3f384-d7ab-4740-9475-99ee38739503 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:14:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:44 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:44 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:44 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:14:44 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:14:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b52044-aa5a-4e99-ad0b-c6b338aac34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c07183a-3330-4ae7-b52d-d15ee6919387', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed5cbd1-c11d-4276-94ef-666cba25d2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:44 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503 1073741824 Apr 15 20:14:44 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:44 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Volume volume-9c07183a-3330-4ae7-b52d-d15ee6919387 (9c07183a-3330-4ae7-b52d-d15ee6919387): created successfully Apr 15 20:14:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed5cbd1-c11d-4276-94ef-666cba25d2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:44 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Flow 'volume_create_manager' (28084ec4-c120-48a8-9c13-b51f26bab8b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:44 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-ff09819e-840a-4494-9261-159f4d469c29 tempest-CreateVolumesFromImageTest-2068535951 None] Created volume successfully. Apr 15 20:14:44 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503 1073741824" returned: 0 in 0.544s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:44 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:44 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503 Apr 15 20:14:44 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:45 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503" returned: 0 in 0.514s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:45 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:14:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.172s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:45 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1240939631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb2bc4a5-cc4a-475e-8a1b-be8213511e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0340c497c824375919e0ad09d462eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:41Z,use_quota=True,user_id='5ccaa57e4c6544f79680948c294abb06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:14:45 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Creating volume eb2bc4a5-cc4a-475e-8a1b-be8213511e78 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:14:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:45 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:45 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:45 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:14:45 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:14:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eb2bc4a5-cc4a-475e-8a1b-be8213511e78 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3ecc0f-7078-46c0-bb50-4765f546c1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5da3f384-d7ab-4740-9475-99ee38739503', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:45 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eb2bc4a5-cc4a-475e-8a1b-be8213511e78 1073741824 Apr 15 20:14:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (727190ea-45d7-4eca-8500-11c439cc7a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:45 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:45 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Volume volume-5da3f384-d7ab-4740-9475-99ee38739503 (5da3f384-d7ab-4740-9475-99ee38739503): created successfully Apr 15 20:14:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (727190ea-45d7-4eca-8500-11c439cc7a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:45 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Flow 'volume_create_manager' (54ab36a4-1aa7-488b-8d1d-acd079bed453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:45 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-04fb8549-060b-4654-92f7-6366964804db tempest-CreateVolumesFromSnapshotTest-1008667287 None] Created volume successfully. Apr 15 20:14:45 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eb2bc4a5-cc4a-475e-8a1b-be8213511e78 1073741824" returned: 0 in 0.513s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:45 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eb2bc4a5-cc4a-475e-8a1b-be8213511e78 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:45 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eb2bc4a5-cc4a-475e-8a1b-be8213511e78 Apr 15 20:14:45 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f9050c04-3a5f-418b-945b-0406b746bd0c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:46 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eb2bc4a5-cc4a-475e-8a1b-be8213511e78" returned: 0 in 0.510s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:46 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:14:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.946s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:46 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1687369136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68bc6466-c736-4bc4-89be-20e62d25e5be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0340c497c824375919e0ad09d462eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:41Z,use_quota=True,user_id='5ccaa57e4c6544f79680948c294abb06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:14:46 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Creating volume 68bc6466-c736-4bc4-89be-20e62d25e5be {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:14:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:46 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:46 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:46 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:14:46 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:14:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68bc6466-c736-4bc4-89be-20e62d25e5be 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:46 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68bc6466-c736-4bc4-89be-20e62d25e5be 1073741824 Apr 15 20:14:46 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:46 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6acb28-f986-4ac0-90a8-0c6b73dacf5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb2bc4a5-cc4a-475e-8a1b-be8213511e78', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:46 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b1be1d-8e84-4c2a-9469-90aac6f265f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:46 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Volume volume-eb2bc4a5-cc4a-475e-8a1b-be8213511e78 (eb2bc4a5-cc4a-475e-8a1b-be8213511e78): created successfully Apr 15 20:14:46 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b1be1d-8e84-4c2a-9469-90aac6f265f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:46 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Flow 'volume_create_manager' (bda3bfcc-92e3-43be-abf5-799a5efeb1b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:46 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-e1fe88cc-3db8-4c10-b4c9-7ac00dd953c8 tempest-CreateVolumesFromImageTest-2068535951 None] Created volume successfully. Apr 15 20:14:46 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68bc6466-c736-4bc4-89be-20e62d25e5be 1073741824" returned: 0 in 0.600s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:46 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68bc6466-c736-4bc4-89be-20e62d25e5be {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:46 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68bc6466-c736-4bc4-89be-20e62d25e5be Apr 15 20:14:46 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:47 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68bc6466-c736-4bc4-89be-20e62d25e5be" returned: 0 in 0.463s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:47 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:14:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.824s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:47 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2022321750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3dfe50-3c5a-425b-acbf-5583eea6b36a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0340c497c824375919e0ad09d462eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:41Z,use_quota=True,user_id='5ccaa57e4c6544f79680948c294abb06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:14:47 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Creating volume fa3dfe50-3c5a-425b-acbf-5583eea6b36a {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:14:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:47 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:47 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:47 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:14:47 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:14:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fa3dfe50-3c5a-425b-acbf-5583eea6b36a 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:47 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945c94f5-2abd-442d-ac01-6a702077efc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68bc6466-c736-4bc4-89be-20e62d25e5be', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:47 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fa3dfe50-3c5a-425b-acbf-5583eea6b36a 1073741824 Apr 15 20:14:47 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:47 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac4b606-1914-4b37-a88a-3da6f5acf17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:47 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Volume volume-68bc6466-c736-4bc4-89be-20e62d25e5be (68bc6466-c736-4bc4-89be-20e62d25e5be): created successfully Apr 15 20:14:47 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac4b606-1914-4b37-a88a-3da6f5acf17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:47 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Flow 'volume_create_manager' (33706e7e-e97b-41e6-9583-0f84c6646522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:47 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-472160d4-8d71-4cde-899e-40483d2366ad tempest-CreateVolumesFromImageTest-2068535951 None] Created volume successfully. Apr 15 20:14:47 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:47 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fa3dfe50-3c5a-425b-acbf-5583eea6b36a 1073741824" returned: 0 in 0.553s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fa3dfe50-3c5a-425b-acbf-5583eea6b36a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:48 devstack sudo[90464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fa3dfe50-3c5a-425b-acbf-5583eea6b36a Apr 15 20:14:48 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:48 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fa3dfe50-3c5a-425b-acbf-5583eea6b36a" returned: 0 in 0.454s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:14:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d77af997-5a3b-4059-9836-17e95a7325b8 tempest-VolumeDependencyTests-116051424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.459s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3367e06-75a4-4199-9c8d-171e15de4c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa3dfe50-3c5a-425b-acbf-5583eea6b36a', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b657b8ff-9601-459c-b9b6-97d71a3e5d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:48 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-d77af997-5a3b-4059-9836-17e95a7325b8 tempest-VolumeDependencyTests-116051424 None] Creating offline snapshot b6e9b5c1-7a9a-46a9-8048-15f42599f5f7 of volume ba9882e9-0897-42ce-91d5-0a9e3a78821d {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:14:48 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Volume volume-fa3dfe50-3c5a-425b-acbf-5583eea6b36a (fa3dfe50-3c5a-425b-acbf-5583eea6b36a): created successfully Apr 15 20:14:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b657b8ff-9601-459c-b9b6-97d71a3e5d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:48 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Flow 'volume_create_manager' (af227f64-6925-4bf2-b5e6-19d6447a3775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:48 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c286452-29e8-4d79-a79d-3b1f2b6ab2f5]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:48 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d77af997-5a3b-4059-9836-17e95a7325b8 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:48 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-3dc29e9e-cb39-4155-9c1e-823a54052957 tempest-CreateVolumesFromImageTest-2068535951 None] Created volume successfully. Apr 15 20:14:48 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d Apr 15 20:14:48 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:48 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d77af997-5a3b-4059-9836-17e95a7325b8 tempest-VolumeDependencyTests-116051424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d" returned: 0 in 0.498s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d77af997-5a3b-4059-9836-17e95a7325b8 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.b6e9b5c1-7a9a-46a9-8048-15f42599f5f7 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:49 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.b6e9b5c1-7a9a-46a9-8048-15f42599f5f7 1G Apr 15 20:14:49 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-bbb4d08f-4887-4eee-b44b-96f423dc21be tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "cinder-fa3dfe50-3c5a-425b-acbf-5583eea6b36a-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-bbb4d08f-4887-4eee-b44b-96f423dc21be tempest-CreateVolumesFromImageTest-2068535951 None] Lock "cinder-fa3dfe50-3c5a-425b-acbf-5583eea6b36a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-bbb4d08f-4887-4eee-b44b-96f423dc21be tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "cinder-quobyte-fa3dfe50-3c5a-425b-acbf-5583eea6b36a" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:49 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-bbb4d08f-4887-4eee-b44b-96f423dc21be tempest-CreateVolumesFromImageTest-2068535951 None] Lock "cinder-quobyte-fa3dfe50-3c5a-425b-acbf-5583eea6b36a" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:49 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd698d4-518c-4432-81ea-846a4c704d53]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bbb4d08f-4887-4eee-b44b-96f423dc21be tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fa3dfe50-3c5a-425b-acbf-5583eea6b36a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:49 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fa3dfe50-3c5a-425b-acbf-5583eea6b36a Apr 15 20:14:49 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:49 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d77af997-5a3b-4059-9836-17e95a7325b8 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.b6e9b5c1-7a9a-46a9-8048-15f42599f5f7 1G" returned: 0 in 0.526s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d77af997-5a3b-4059-9836-17e95a7325b8 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.b6e9b5c1-7a9a-46a9-8048-15f42599f5f7 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:49 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.b6e9b5c1-7a9a-46a9-8048-15f42599f5f7 Apr 15 20:14:49 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:49 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bbb4d08f-4887-4eee-b44b-96f423dc21be tempest-CreateVolumesFromImageTest-2068535951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fa3dfe50-3c5a-425b-acbf-5583eea6b36a" returned: 0 in 0.613s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:49 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bbb4d08f-4887-4eee-b44b-96f423dc21be tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fa3dfe50-3c5a-425b-acbf-5583eea6b36a {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:49 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fa3dfe50-3c5a-425b-acbf-5583eea6b36a Apr 15 20:14:49 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:50 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d77af997-5a3b-4059-9836-17e95a7325b8 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.b6e9b5c1-7a9a-46a9-8048-15f42599f5f7" returned: 0 in 0.498s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:50 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-d77af997-5a3b-4059-9836-17e95a7325b8 tempest-VolumeDependencyTests-116051424 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.b6e9b5c1-7a9a-46a9-8048-15f42599f5f7 is being set with open permissions: ugo+rw Apr 15 20:14:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d77af997-5a3b-4059-9836-17e95a7325b8 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.b6e9b5c1-7a9a-46a9-8048-15f42599f5f7 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:50 devstack sudo[90489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.b6e9b5c1-7a9a-46a9-8048-15f42599f5f7 Apr 15 20:14:50 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:50 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bbb4d08f-4887-4eee-b44b-96f423dc21be tempest-CreateVolumesFromImageTest-2068535951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-fa3dfe50-3c5a-425b-acbf-5583eea6b36a" returned: 0 in 0.510s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:50 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-bbb4d08f-4887-4eee-b44b-96f423dc21be tempest-CreateVolumesFromImageTest-2068535951 None] Lock "cinder-quobyte-fa3dfe50-3c5a-425b-acbf-5583eea6b36a" released by "delete_volume" :: held 1.155s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:50 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-bbb4d08f-4887-4eee-b44b-96f423dc21be tempest-CreateVolumesFromImageTest-2068535951 None] Created reservations ['9a03fd87-bfb7-4438-abda-5fd4a135dced', 'acd48af7-bd30-4806-8269-84ccd41d8146', '18c580cf-b80c-4490-ab3a-8f8dfb23a7eb', '73c78142-de5b-47bf-8aad-9c0fde64c694'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:14:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-bbb4d08f-4887-4eee-b44b-96f423dc21be tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-bbb4d08f-4887-4eee-b44b-96f423dc21be tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:50 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-bbb4d08f-4887-4eee-b44b-96f423dc21be tempest-CreateVolumesFromImageTest-2068535951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:50 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-bbb4d08f-4887-4eee-b44b-96f423dc21be tempest-CreateVolumesFromImageTest-2068535951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-bbb4d08f-4887-4eee-b44b-96f423dc21be tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bbb4d08f-4887-4eee-b44b-96f423dc21be tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:50 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:14:50 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:50 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d77af997-5a3b-4059-9836-17e95a7325b8 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.b6e9b5c1-7a9a-46a9-8048-15f42599f5f7" returned: 0 in 0.443s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d77af997-5a3b-4059-9836-17e95a7325b8 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:50 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.info Apr 15 20:14:50 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:50 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-bbb4d08f-4887-4eee-b44b-96f423dc21be tempest-CreateVolumesFromImageTest-2068535951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.505s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:50 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-bbb4d08f-4887-4eee-b44b-96f423dc21be tempest-CreateVolumesFromImageTest-2068535951 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:14:50 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-bbb4d08f-4887-4eee-b44b-96f423dc21be tempest-CreateVolumesFromImageTest-2068535951 None] Deleted volume successfully. Apr 15 20:14:50 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-bbb4d08f-4887-4eee-b44b-96f423dc21be tempest-CreateVolumesFromImageTest-2068535951 None] Lock "cinder-fa3dfe50-3c5a-425b-acbf-5583eea6b36a-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:50 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d77af997-5a3b-4059-9836-17e95a7325b8 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.info" returned: 0 in 0.500s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:50 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-d77af997-5a3b-4059-9836-17e95a7325b8 tempest-VolumeDependencyTests-116051424 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.info is being set with open permissions: ugo+rw Apr 15 20:14:50 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d77af997-5a3b-4059-9836-17e95a7325b8 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:51 devstack sudo[90499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.info Apr 15 20:14:51 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:51 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-64f96e51-5cf6-4afd-ad32-27d6a4b54543 tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "cinder-68bc6466-c736-4bc4-89be-20e62d25e5be-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:51 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-64f96e51-5cf6-4afd-ad32-27d6a4b54543 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "cinder-68bc6466-c736-4bc4-89be-20e62d25e5be-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:51 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-64f96e51-5cf6-4afd-ad32-27d6a4b54543 tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "cinder-quobyte-68bc6466-c736-4bc4-89be-20e62d25e5be" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:51 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-64f96e51-5cf6-4afd-ad32-27d6a4b54543 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "cinder-quobyte-68bc6466-c736-4bc4-89be-20e62d25e5be" acquired by "delete_volume" :: waited 0.012s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:51 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd060fd-0384-4a91-9eba-6e34fb7dc768]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-64f96e51-5cf6-4afd-ad32-27d6a4b54543 tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68bc6466-c736-4bc4-89be-20e62d25e5be {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:51 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-d77af997-5a3b-4059-9836-17e95a7325b8 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.info" returned: 0 in 0.483s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-d77af997-5a3b-4059-9836-17e95a7325b8 tempest-VolumeDependencyTests-116051424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.026s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f9050c04-3a5f-418b-945b-0406b746bd0c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.276s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:51 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68bc6466-c736-4bc4-89be-20e62d25e5be Apr 15 20:14:51 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:51 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-f9050c04-3a5f-418b-945b-0406b746bd0c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Creating offline snapshot 8a5002b5-ba1c-4662-9ea4-2d1b5763f99b of volume 5da3f384-d7ab-4740-9475-99ee38739503 {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:14:51 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[2045a215-c193-4a71-84c4-4ef463a9d118]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:51 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f9050c04-3a5f-418b-945b-0406b746bd0c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:51 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-d77af997-5a3b-4059-9836-17e95a7325b8 tempest-VolumeDependencyTests-116051424 None] Create snapshot completed successfully Apr 15 20:14:51 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503 Apr 15 20:14:51 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:52 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-64f96e51-5cf6-4afd-ad32-27d6a4b54543 tempest-CreateVolumesFromImageTest-2068535951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68bc6466-c736-4bc4-89be-20e62d25e5be" returned: 0 in 0.609s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-64f96e51-5cf6-4afd-ad32-27d6a4b54543 tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68bc6466-c736-4bc4-89be-20e62d25e5be {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:52 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68bc6466-c736-4bc4-89be-20e62d25e5be Apr 15 20:14:52 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:52 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f9050c04-3a5f-418b-945b-0406b746bd0c tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503" returned: 0 in 0.574s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f9050c04-3a5f-418b-945b-0406b746bd0c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.8a5002b5-ba1c-4662-9ea4-2d1b5763f99b 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:52 devstack sudo[90516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.8a5002b5-ba1c-4662-9ea4-2d1b5763f99b 1G Apr 15 20:14:52 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:52 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-64f96e51-5cf6-4afd-ad32-27d6a4b54543 tempest-CreateVolumesFromImageTest-2068535951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-68bc6466-c736-4bc4-89be-20e62d25e5be" returned: 0 in 0.553s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-64f96e51-5cf6-4afd-ad32-27d6a4b54543 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "cinder-quobyte-68bc6466-c736-4bc4-89be-20e62d25e5be" released by "delete_volume" :: held 1.202s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-64f96e51-5cf6-4afd-ad32-27d6a4b54543 tempest-CreateVolumesFromImageTest-2068535951 None] Created reservations ['425b9a24-c6db-449a-8ac2-b50da5f42c8e', '8f5fbb2a-93d4-49ef-8eb7-fda4dc2dc7a4', '8e8a28b5-e9b6-4a5b-ae3c-5e3a04bc2097', '0b7f43cc-6b4a-4cef-ae8e-0c71dad2a4d2'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:14:52 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f9050c04-3a5f-418b-945b-0406b746bd0c tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.8a5002b5-ba1c-4662-9ea4-2d1b5763f99b 1G" returned: 0 in 0.691s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f9050c04-3a5f-418b-945b-0406b746bd0c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da3f384-d7ab-4740-9475-99ee38739503 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.8a5002b5-ba1c-4662-9ea4-2d1b5763f99b {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-64f96e51-5cf6-4afd-ad32-27d6a4b54543 tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-64f96e51-5cf6-4afd-ad32-27d6a4b54543 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-64f96e51-5cf6-4afd-ad32-27d6a4b54543 tempest-CreateVolumesFromImageTest-2068535951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-64f96e51-5cf6-4afd-ad32-27d6a4b54543 tempest-CreateVolumesFromImageTest-2068535951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-64f96e51-5cf6-4afd-ad32-27d6a4b54543 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-64f96e51-5cf6-4afd-ad32-27d6a4b54543 tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:52 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da3f384-d7ab-4740-9475-99ee38739503 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.8a5002b5-ba1c-4662-9ea4-2d1b5763f99b Apr 15 20:14:52 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:52 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:14:52 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Flow 'volume_create_manager' (2cadcfcf-470b-4d14-9810-6208022b5c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d720c1-3354-42d6-8a0f-3285423c35f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d720c1-3354-42d6-8a0f-3285423c35f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-958395699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d626a61-46d0-41f7-bb51-4602c062ad9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca62bf5cd72487c9bc3e4103ad1e30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b6e9b5c1-7a9a-46a9-8048-15f42599f5f7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:53Z,use_quota=True,user_id='db99822632054502994d318bed45b069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3339ad77-272e-4554-a503-d0c4871d7d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3339ad77-272e-4554-a503-d0c4871d7d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b5a1f8-6e55-4f6c-825d-ac54e6b77888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b5a1f8-6e55-4f6c-825d-ac54e6b77888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5d626a61-46d0-41f7-bb51-4602c062ad9f', 'volume_name': 'volume-5d626a61-46d0-41f7-bb51-4602c062ad9f', 'volume_size': 1, 'snapshot_id': 'b6e9b5c1-7a9a-46a9-8048-15f42599f5f7'}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b327a7-b5d5-4561-9b74-1dc9dba2372c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b327a7-b5d5-4561-9b74-1dc9dba2372c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd07951-a268-4d2c-8e67-fcec10a88869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:52 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Volume 5d626a61-46d0-41f7-bb51-4602c062ad9f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5d626a61-46d0-41f7-bb51-4602c062ad9f', 'volume_size': 1, 'snapshot_id': 'b6e9b5c1-7a9a-46a9-8048-15f42599f5f7'} Apr 15 20:14:52 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:53 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-64f96e51-5cf6-4afd-ad32-27d6a4b54543 tempest-CreateVolumesFromImageTest-2068535951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.420s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:53 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-64f96e51-5cf6-4afd-ad32-27d6a4b54543 tempest-CreateVolumesFromImageTest-2068535951 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:14:53 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-64f96e51-5cf6-4afd-ad32-27d6a4b54543 tempest-CreateVolumesFromImageTest-2068535951 None] Deleted volume successfully. Apr 15 20:14:53 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-64f96e51-5cf6-4afd-ad32-27d6a4b54543 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "cinder-68bc6466-c736-4bc4-89be-20e62d25e5be-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:53 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f9050c04-3a5f-418b-945b-0406b746bd0c tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da3f384-d7ab-4740-9475-99ee38739503 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.8a5002b5-ba1c-4662-9ea4-2d1b5763f99b" returned: 0 in 0.598s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:53 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-f9050c04-3a5f-418b-945b-0406b746bd0c tempest-CreateVolumesFromSnapshotTest-1008667287 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.8a5002b5-ba1c-4662-9ea4-2d1b5763f99b is being set with open permissions: ugo+rw Apr 15 20:14:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f9050c04-3a5f-418b-945b-0406b746bd0c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.8a5002b5-ba1c-4662-9ea4-2d1b5763f99b {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:53 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.8a5002b5-ba1c-4662-9ea4-2d1b5763f99b Apr 15 20:14:53 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:53 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ae438cbc-70d3-487f-a0eb-60af6d6854c1 tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "cinder-eb2bc4a5-cc4a-475e-8a1b-be8213511e78-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:53 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ae438cbc-70d3-487f-a0eb-60af6d6854c1 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "cinder-eb2bc4a5-cc4a-475e-8a1b-be8213511e78-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:53 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ae438cbc-70d3-487f-a0eb-60af6d6854c1 tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "cinder-quobyte-eb2bc4a5-cc4a-475e-8a1b-be8213511e78" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:53 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ae438cbc-70d3-487f-a0eb-60af6d6854c1 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "cinder-quobyte-eb2bc4a5-cc4a-475e-8a1b-be8213511e78" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:53 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff77131d-f9fb-4eaf-803f-e08f35de5618]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ae438cbc-70d3-487f-a0eb-60af6d6854c1 tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eb2bc4a5-cc4a-475e-8a1b-be8213511e78 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:53 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eb2bc4a5-cc4a-475e-8a1b-be8213511e78 Apr 15 20:14:53 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:53 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:53 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f9050c04-3a5f-418b-945b-0406b746bd0c tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.8a5002b5-ba1c-4662-9ea4-2d1b5763f99b" returned: 0 in 0.600s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f9050c04-3a5f-418b-945b-0406b746bd0c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:54 devstack sudo[90537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.info Apr 15 20:14:54 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:54 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ae438cbc-70d3-487f-a0eb-60af6d6854c1 tempest-CreateVolumesFromImageTest-2068535951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eb2bc4a5-cc4a-475e-8a1b-be8213511e78" returned: 0 in 0.744s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ae438cbc-70d3-487f-a0eb-60af6d6854c1 tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eb2bc4a5-cc4a-475e-8a1b-be8213511e78 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:54 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eb2bc4a5-cc4a-475e-8a1b-be8213511e78 Apr 15 20:14:54 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:54 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f9050c04-3a5f-418b-945b-0406b746bd0c tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.info" returned: 0 in 0.521s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:54 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-f9050c04-3a5f-418b-945b-0406b746bd0c tempest-CreateVolumesFromSnapshotTest-1008667287 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.info is being set with open permissions: ugo+rw Apr 15 20:14:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f9050c04-3a5f-418b-945b-0406b746bd0c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:54 devstack sudo[90545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.info Apr 15 20:14:54 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:54 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Flow 'volume_create_manager' (8b2186d2-00a3-4236-98d1-e13347d1ac15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897c2c83-4b09-4657-8e00-d0bd1482959d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897c2c83-4b09-4657-8e00-d0bd1482959d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1309020225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad95f9b0-54a7-42da-9634-01b5b441c13c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c5d7561f2bc422d8751e3eb688f716b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:55Z,use_quota=True,user_id='3481e4c1d35f443b98ee1664be97caaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbeaa5f-06e4-45d8-8fc7-ef38d4fbe3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbeaa5f-06e4-45d8-8fc7-ef38d4fbe3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a628b44-85fe-4b01-ae92-c3a242dd0709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a628b44-85fe-4b01-ae92-c3a242dd0709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad95f9b0-54a7-42da-9634-01b5b441c13c', 'volume_name': 'volume-ad95f9b0-54a7-42da-9634-01b5b441c13c', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e49fdd0-1f29-4c40-bce6-4e40d009ff53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e49fdd0-1f29-4c40-bce6-4e40d009ff53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:54 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (719f1dcd-ac5e-4dc0-b3f9-f8bbd156c6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:54 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Volume ad95f9b0-54a7-42da-9634-01b5b441c13c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad95f9b0-54a7-42da-9634-01b5b441c13c', 'volume_size': 1} Apr 15 20:14:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:54 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:54 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ae438cbc-70d3-487f-a0eb-60af6d6854c1 tempest-CreateVolumesFromImageTest-2068535951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-eb2bc4a5-cc4a-475e-8a1b-be8213511e78" returned: 0 in 0.516s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:54 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ae438cbc-70d3-487f-a0eb-60af6d6854c1 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "cinder-quobyte-eb2bc4a5-cc4a-475e-8a1b-be8213511e78" released by "delete_volume" :: held 1.281s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:54 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-ae438cbc-70d3-487f-a0eb-60af6d6854c1 tempest-CreateVolumesFromImageTest-2068535951 None] Created reservations ['af8bc22f-f39b-433b-8eb6-cfcd869ff1c5', '3787f351-1ffd-4641-bf98-d05093ca8d5a', '6f19469f-2020-436e-a829-4edef248cfdb', 'f714bf0d-cef0-462b-9dbe-e785a2678499'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ae438cbc-70d3-487f-a0eb-60af6d6854c1 tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ae438cbc-70d3-487f-a0eb-60af6d6854c1 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ae438cbc-70d3-487f-a0eb-60af6d6854c1 tempest-CreateVolumesFromImageTest-2068535951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:55 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ae438cbc-70d3-487f-a0eb-60af6d6854c1 tempest-CreateVolumesFromImageTest-2068535951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ae438cbc-70d3-487f-a0eb-60af6d6854c1 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ae438cbc-70d3-487f-a0eb-60af6d6854c1 tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f9050c04-3a5f-418b-945b-0406b746bd0c tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.info" returned: 0 in 0.510s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f9050c04-3a5f-418b-945b-0406b746bd0c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.570s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.112s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Acquiring lock "cinder-quobyte-b6e9b5c1-7a9a-46a9-8048-15f42599f5f7-5d626a61-46d0-41f7-bb51-4602c062ad9f" by "_create_volume_from_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:55 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:14:55 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Lock "cinder-quobyte-b6e9b5c1-7a9a-46a9-8048-15f42599f5f7-5d626a61-46d0-41f7-bb51-4602c062ad9f" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Creating volume 5d626a61-46d0-41f7-bb51-4602c062ad9f from snapshot b6e9b5c1-7a9a-46a9-8048-15f42599f5f7 {{(pid=82989) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Acquiring lock "cinder-quobyte-5d626a61-46d0-41f7-bb51-4602c062ad9f" by "_copy_volume_from_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Lock "cinder-quobyte-5d626a61-46d0-41f7-bb51-4602c062ad9f" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] snapshot: b6e9b5c1-7a9a-46a9-8048-15f42599f5f7, volume: 5d626a61-46d0-41f7-bb51-4602c062ad9f, {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 20:14:55 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-f9050c04-3a5f-418b-945b-0406b746bd0c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Create snapshot completed successfully Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4124641-7d3f-47de-bf9e-6522add421f4]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.b6e9b5c1-7a9a-46a9-8048-15f42599f5f7 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:55 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.b6e9b5c1-7a9a-46a9-8048-15f42599f5f7 Apr 15 20:14:55 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:55 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ae438cbc-70d3-487f-a0eb-60af6d6854c1 tempest-CreateVolumesFromImageTest-2068535951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.430s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-ae438cbc-70d3-487f-a0eb-60af6d6854c1 tempest-CreateVolumesFromImageTest-2068535951 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:14:55 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-ae438cbc-70d3-487f-a0eb-60af6d6854c1 tempest-CreateVolumesFromImageTest-2068535951 None] Deleted volume successfully. Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-ae438cbc-70d3-487f-a0eb-60af6d6854c1 tempest-CreateVolumesFromImageTest-2068535951 None] Lock "cinder-eb2bc4a5-cc4a-475e-8a1b-be8213511e78-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:55 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.b6e9b5c1-7a9a-46a9-8048-15f42599f5f7" returned: 0 in 0.504s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Creating direct copy from snapshot {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0a32fe-be68-4680-a8a0-80680166e086]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:55 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d Apr 15 20:14:55 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-86c8a4b5-8f17-4b6b-afbe-4fe5dc8286bf tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "cinder-9c07183a-3330-4ae7-b52d-d15ee6919387-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Flow 'volume_create_manager' (f3f7e438-c72a-4c4f-9625-72cc17c31871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (288b01d2-3bca-45ca-b8e2-9ea0be538ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-86c8a4b5-8f17-4b6b-afbe-4fe5dc8286bf tempest-CreateVolumesFromImageTest-2068535951 None] Lock "cinder-9c07183a-3330-4ae7-b52d-d15ee6919387-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (288b01d2-3bca-45ca-b8e2-9ea0be538ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1519081685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d0a5d7-e9ac-4feb-a39a-166585f8668f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bca39e0b413f463ba72f63b2e3c28155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:56Z,use_quota=True,user_id='679cde384c8148fd9df4cee5c5ffb6d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774f23d9-5044-44ab-8486-eaf015468177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774f23d9-5044-44ab-8486-eaf015468177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1342595a-4244-48d5-8100-73220a99ce5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1342595a-4244-48d5-8100-73220a99ce5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89d0a5d7-e9ac-4feb-a39a-166585f8668f', 'volume_name': 'volume-89d0a5d7-e9ac-4feb-a39a-166585f8668f', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8fd3f23-0903-4483-97e7-ebda5fc9f4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8fd3f23-0903-4483-97e7-ebda5fc9f4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c847e8bc-0f15-4259-bc19-91a09ee7c47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:55 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Volume 89d0a5d7-e9ac-4feb-a39a-166585f8668f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89d0a5d7-e9ac-4feb-a39a-166585f8668f', 'volume_size': 1} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-86c8a4b5-8f17-4b6b-afbe-4fe5dc8286bf tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "cinder-quobyte-9c07183a-3330-4ae7-b52d-d15ee6919387" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-86c8a4b5-8f17-4b6b-afbe-4fe5dc8286bf tempest-CreateVolumesFromImageTest-2068535951 None] Lock "cinder-quobyte-9c07183a-3330-4ae7-b52d-d15ee6919387" acquired by "delete_volume" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4de4c7b-14fa-4930-a5a6-3b388ee15746]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:55 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-86c8a4b5-8f17-4b6b-afbe-4fe5dc8286bf tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-9c07183a-3330-4ae7-b52d-d15ee6919387 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:56 devstack sudo[90559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-9c07183a-3330-4ae7-b52d-d15ee6919387 Apr 15 20:14:56 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Flow 'volume_create_manager' (c15ad370-01bf-4ced-b543-0a294de0e760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416fccf6-e47f-438f-ac72-37a0b5672826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416fccf6-e47f-438f-ac72-37a0b5672826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-40646175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061d110d-0f76-4246-a81a-3a2565f8b276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bca39e0b413f463ba72f63b2e3c28155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:56Z,use_quota=True,user_id='679cde384c8148fd9df4cee5c5ffb6d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314973a2-9374-4086-b4c1-0680f14450d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314973a2-9374-4086-b4c1-0680f14450d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ce3431-c647-48ab-8caa-559e02f4199b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ce3431-c647-48ab-8caa-559e02f4199b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '061d110d-0f76-4246-a81a-3a2565f8b276', 'volume_name': 'volume-061d110d-0f76-4246-a81a-3a2565f8b276', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da9b539-2e7c-4917-9042-9160d3881361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da9b539-2e7c-4917-9042-9160d3881361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06881c45-ed59-4599-ab8c-93c90736a798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:56 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Volume 061d110d-0f76-4246-a81a-3a2565f8b276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-061d110d-0f76-4246-a81a-3a2565f8b276', 'volume_size': 1} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:56 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d" returned: 0 in 0.536s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.utils [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Path /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d626a61-46d0-41f7-bb51-4602c062ad9f not found in is_blk_device check {{(pid=82989) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d626a61-46d0-41f7-bb51-4602c062ad9f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:56 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d626a61-46d0-41f7-bb51-4602c062ad9f Apr 15 20:14:56 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Flow 'volume_create_manager' (89b3a1dd-07cd-4b20-a2d3-1b60c8250599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced4aecb-efcf-44dc-b2e2-e9385ae1ac7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced4aecb-efcf-44dc-b2e2-e9385ae1ac7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1587207672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1abf425-5a11-44b8-a3bc-0832867526cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bca39e0b413f463ba72f63b2e3c28155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:56Z,use_quota=True,user_id='679cde384c8148fd9df4cee5c5ffb6d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de54f123-368c-46fe-95d7-f4d76b71e805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de54f123-368c-46fe-95d7-f4d76b71e805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b48a84a-6778-4b43-9ad8-3d4ead73b2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b48a84a-6778-4b43-9ad8-3d4ead73b2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1abf425-5a11-44b8-a3bc-0832867526cb', 'volume_name': 'volume-f1abf425-5a11-44b8-a3bc-0832867526cb', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f6ccd2-b9fa-4947-b1d7-40c49907fd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f6ccd2-b9fa-4947-b1d7-40c49907fd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384a67c6-7318-4fd7-b521-9cebcbc91fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:56 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Volume f1abf425-5a11-44b8-a3bc-0832867526cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1abf425-5a11-44b8-a3bc-0832867526cb', 'volume_size': 1} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Flow 'volume_create_manager' (8385353b-fffc-4e7d-b280-4e03da685bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be376c76-3e20-4ff4-aac0-4aa9041abf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be376c76-3e20-4ff4-aac0-4aa9041abf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-341991513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18d2971-9f99-4dc2-9c76-2dcc12e80d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bca39e0b413f463ba72f63b2e3c28155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:56Z,use_quota=True,user_id='679cde384c8148fd9df4cee5c5ffb6d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b4da9d-cdc5-463f-901c-24dcb3362647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b4da9d-cdc5-463f-901c-24dcb3362647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e98194-dec6-465e-b54a-f39d2e219ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e98194-dec6-465e-b54a-f39d2e219ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b18d2971-9f99-4dc2-9c76-2dcc12e80d57', 'volume_name': 'volume-b18d2971-9f99-4dc2-9c76-2dcc12e80d57', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56216bce-bbbe-4793-8ce0-83fcc8768c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56216bce-bbbe-4793-8ce0-83fcc8768c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:56 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13089e0d-6e27-400f-b3ef-2b55869def4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:56 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Volume b18d2971-9f99-4dc2-9c76-2dcc12e80d57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b18d2971-9f99-4dc2-9c76-2dcc12e80d57', 'volume_size': 1} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-86c8a4b5-8f17-4b6b-afbe-4fe5dc8286bf tempest-CreateVolumesFromImageTest-2068535951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-9c07183a-3330-4ae7-b52d-d15ee6919387" returned: 0 in 0.615s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-86c8a4b5-8f17-4b6b-afbe-4fe5dc8286bf tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-9c07183a-3330-4ae7-b52d-d15ee6919387 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:56 devstack sudo[90571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-9c07183a-3330-4ae7-b52d-d15ee6919387 Apr 15 20:14:56 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Flow 'volume_create_manager' (33d9d52f-60a2-418b-9e80-9c85a421b4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb58c61-47e6-4d7f-be69-5bc9d08668e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb58c61-47e6-4d7f-be69-5bc9d08668e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1221982827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aae6db2-4e66-4f6b-93e6-3477052e36eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bca39e0b413f463ba72f63b2e3c28155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:57Z,use_quota=True,user_id='679cde384c8148fd9df4cee5c5ffb6d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b05bcb-587a-4e16-88e8-66e6b088d841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b05bcb-587a-4e16-88e8-66e6b088d841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79952543-cc3e-4e8f-b521-d2bfd292bb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79952543-cc3e-4e8f-b521-d2bfd292bb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aae6db2-4e66-4f6b-93e6-3477052e36eb', 'volume_name': 'volume-7aae6db2-4e66-4f6b-93e6-3477052e36eb', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ceb030e-f9b1-4450-a508-aad89c1971e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ceb030e-f9b1-4450-a508-aad89c1971e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c85497-9602-4ce3-8391-89d7ed7e7283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:56 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Volume 7aae6db2-4e66-4f6b-93e6-3477052e36eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aae6db2-4e66-4f6b-93e6-3477052e36eb', 'volume_size': 1} Apr 15 20:14:56 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:57 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-86c8a4b5-8f17-4b6b-afbe-4fe5dc8286bf tempest-CreateVolumesFromImageTest-2068535951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-9c07183a-3330-4ae7-b52d-d15ee6919387" returned: 0 in 0.618s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:57 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-86c8a4b5-8f17-4b6b-afbe-4fe5dc8286bf tempest-CreateVolumesFromImageTest-2068535951 None] Lock "cinder-quobyte-9c07183a-3330-4ae7-b52d-d15ee6919387" released by "delete_volume" :: held 1.264s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:57 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-86c8a4b5-8f17-4b6b-afbe-4fe5dc8286bf tempest-CreateVolumesFromImageTest-2068535951 None] Created reservations ['cbf1c383-348f-43e4-b3e1-8c815926b664', '8298caf1-628c-4d6d-84ee-66bd5a1f3a5a', '13bc5c09-4e7f-4d3b-95fa-855d8873a68b', 'ab7f754a-220e-4623-99fd-90eed17a3093'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:14:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-86c8a4b5-8f17-4b6b-afbe-4fe5dc8286bf tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-86c8a4b5-8f17-4b6b-afbe-4fe5dc8286bf tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:57 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-86c8a4b5-8f17-4b6b-afbe-4fe5dc8286bf tempest-CreateVolumesFromImageTest-2068535951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:57 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-86c8a4b5-8f17-4b6b-afbe-4fe5dc8286bf tempest-CreateVolumesFromImageTest-2068535951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-86c8a4b5-8f17-4b6b-afbe-4fe5dc8286bf tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:57 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-86c8a4b5-8f17-4b6b-afbe-4fe5dc8286bf tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:57 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:14:57 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:58 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-547142c7-47fa-4511-b678-e62eea81289f tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "cinder-8bc3742a-6089-4868-aa09-054aaa23e079-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:58 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-547142c7-47fa-4511-b678-e62eea81289f tempest-CreateVolumesFromImageTest-2068535951 None] Lock "cinder-8bc3742a-6089-4868-aa09-054aaa23e079-delete_volume" acquired by "delete_volume" :: waited 0.167s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:58 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-547142c7-47fa-4511-b678-e62eea81289f tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "cinder-quobyte-8bc3742a-6089-4868-aa09-054aaa23e079" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:14:58 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-547142c7-47fa-4511-b678-e62eea81289f tempest-CreateVolumesFromImageTest-2068535951 None] Lock "cinder-quobyte-8bc3742a-6089-4868-aa09-054aaa23e079" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:14:58 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[950292eb-ecde-4b14-a0a8-79dcb9b2577b]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-547142c7-47fa-4511-b678-e62eea81289f tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8bc3742a-6089-4868-aa09-054aaa23e079 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:58 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d626a61-46d0-41f7-bb51-4602c062ad9f" returned: 0 in 2.215s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:58 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[f622a918-eafc-41b9-9eda-7ba16f5f54e0]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:14:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:58 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8bc3742a-6089-4868-aa09-054aaa23e079 Apr 15 20:14:58 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:58 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d Apr 15 20:14:58 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:58 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-86c8a4b5-8f17-4b6b-afbe-4fe5dc8286bf tempest-CreateVolumesFromImageTest-2068535951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 1.089s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:58 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-86c8a4b5-8f17-4b6b-afbe-4fe5dc8286bf tempest-CreateVolumesFromImageTest-2068535951 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:14:58 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-86c8a4b5-8f17-4b6b-afbe-4fe5dc8286bf tempest-CreateVolumesFromImageTest-2068535951 None] Deleted volume successfully. Apr 15 20:14:58 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-86c8a4b5-8f17-4b6b-afbe-4fe5dc8286bf tempest-CreateVolumesFromImageTest-2068535951 None] Lock "cinder-9c07183a-3330-4ae7-b52d-d15ee6919387-delete_volume" released by "delete_volume" :: held 2.728s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:58 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-547142c7-47fa-4511-b678-e62eea81289f tempest-CreateVolumesFromImageTest-2068535951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8bc3742a-6089-4868-aa09-054aaa23e079" returned: 0 in 0.471s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:58 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-547142c7-47fa-4511-b678-e62eea81289f tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8bc3742a-6089-4868-aa09-054aaa23e079 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:58 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8bc3742a-6089-4868-aa09-054aaa23e079 Apr 15 20:14:58 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:59 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d" returned: 0 in 0.629s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d, size 1024.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d626a61-46d0-41f7-bb51-4602c062ad9f {{(pid=82989) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 20:14:59 devstack cinder-volume[82989]: INFO cinder.image.image_utils [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Converted 1024.00 MB image at 462.06 MB/s Apr 15 20:14:59 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d626a61-46d0-41f7-bb51-4602c062ad9f is being set with open permissions: ugo+rw Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d626a61-46d0-41f7-bb51-4602c062ad9f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:59 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d626a61-46d0-41f7-bb51-4602c062ad9f Apr 15 20:14:59 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:59 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-547142c7-47fa-4511-b678-e62eea81289f tempest-CreateVolumesFromImageTest-2068535951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8bc3742a-6089-4868-aa09-054aaa23e079" returned: 0 in 0.420s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-547142c7-47fa-4511-b678-e62eea81289f tempest-CreateVolumesFromImageTest-2068535951 None] Lock "cinder-quobyte-8bc3742a-6089-4868-aa09-054aaa23e079" released by "delete_volume" :: held 0.921s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-547142c7-47fa-4511-b678-e62eea81289f tempest-CreateVolumesFromImageTest-2068535951 None] Created reservations ['0d81e3ff-fc02-4553-8fdb-70d9201dad49', 'de821db0-b68a-4a2f-9ba6-45367efc9b4d', 'cefc1572-4ce4-4bbe-b7e7-fe9a1d04c6af', '496aef42-608e-4aa6-b708-d9bb919b787b'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-547142c7-47fa-4511-b678-e62eea81289f tempest-CreateVolumesFromImageTest-2068535951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-547142c7-47fa-4511-b678-e62eea81289f tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-547142c7-47fa-4511-b678-e62eea81289f tempest-CreateVolumesFromImageTest-2068535951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-547142c7-47fa-4511-b678-e62eea81289f tempest-CreateVolumesFromImageTest-2068535951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-547142c7-47fa-4511-b678-e62eea81289f tempest-CreateVolumesFromImageTest-2068535951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-547142c7-47fa-4511-b678-e62eea81289f tempest-CreateVolumesFromImageTest-2068535951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:59 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:14:59 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:59 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d626a61-46d0-41f7-bb51-4602c062ad9f" returned: 0 in 0.440s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Lock "cinder-quobyte-5d626a61-46d0-41f7-bb51-4602c062ad9f" released by "_copy_volume_from_snapshot" :: held 4.392s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Lock "cinder-quobyte-b6e9b5c1-7a9a-46a9-8048-15f42599f5f7-5d626a61-46d0-41f7-bb51-4602c062ad9f" released by "_create_volume_from_snapshot" :: held 4.410s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.429s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.799s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1309020225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad95f9b0-54a7-42da-9634-01b5b441c13c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c5d7561f2bc422d8751e3eb688f716b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:55Z,use_quota=True,user_id='3481e4c1d35f443b98ee1664be97caaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Creating volume ad95f9b0-54a7-42da-9634-01b5b441c13c {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:14:59 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:14:59 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c 1073741824 Apr 15 20:14:59 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd07951-a268-4d2c-8e67-fcec10a88869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d626a61-46d0-41f7-bb51-4602c062ad9f', 'volume_size': 1, 'snapshot_id': 'b6e9b5c1-7a9a-46a9-8048-15f42599f5f7'}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6287565-5ca8-43ff-9798-bbdabbdc085a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:14:59 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Volume volume-5d626a61-46d0-41f7-bb51-4602c062ad9f (5d626a61-46d0-41f7-bb51-4602c062ad9f): created successfully Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6287565-5ca8-43ff-9798-bbdabbdc085a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Flow 'volume_create_manager' (2cadcfcf-470b-4d14-9810-6208022b5c6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:14:59 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-58521439-6e37-405a-b53e-87dccb81216e tempest-VolumeDependencyTests-116051424 None] Created volume successfully. Apr 15 20:14:59 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-547142c7-47fa-4511-b678-e62eea81289f tempest-CreateVolumesFromImageTest-2068535951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.453s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-547142c7-47fa-4511-b678-e62eea81289f tempest-CreateVolumesFromImageTest-2068535951 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:14:59 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-547142c7-47fa-4511-b678-e62eea81289f tempest-CreateVolumesFromImageTest-2068535951 None] Deleted volume successfully. Apr 15 20:14:59 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-547142c7-47fa-4511-b678-e62eea81289f tempest-CreateVolumesFromImageTest-2068535951 None] Lock "cinder-8bc3742a-6089-4868-aa09-054aaa23e079-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:00 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c 1073741824" returned: 0 in 0.503s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:00 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c Apr 15 20:15:00 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-041ac209-8cad-4dee-93c0-b1eceb8aade7 tempest-VolumeDependencyTests-116051424 None] Acquiring lock "cinder-b6e9b5c1-7a9a-46a9-8048-15f42599f5f7-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-041ac209-8cad-4dee-93c0-b1eceb8aade7 tempest-VolumeDependencyTests-116051424 None] Lock "cinder-b6e9b5c1-7a9a-46a9-8048-15f42599f5f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-041ac209-8cad-4dee-93c0-b1eceb8aade7 tempest-VolumeDependencyTests-116051424 None] Acquiring lock "cinder-quobyte-ba9882e9-0897-42ce-91d5-0a9e3a78821d" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-041ac209-8cad-4dee-93c0-b1eceb8aade7 tempest-VolumeDependencyTests-116051424 None] Lock "cinder-quobyte-ba9882e9-0897-42ce-91d5-0a9e3a78821d" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-041ac209-8cad-4dee-93c0-b1eceb8aade7 tempest-VolumeDependencyTests-116051424 None] Acquiring lock "cinder-quobyte-b6e9b5c1-7a9a-46a9-8048-15f42599f5f7" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-041ac209-8cad-4dee-93c0-b1eceb8aade7 tempest-VolumeDependencyTests-116051424 None] Lock "cinder-quobyte-b6e9b5c1-7a9a-46a9-8048-15f42599f5f7" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-041ac209-8cad-4dee-93c0-b1eceb8aade7 tempest-VolumeDependencyTests-116051424 None] Deleting offline snapshot b6e9b5c1-7a9a-46a9-8048-15f42599f5f7 of volume ba9882e9-0897-42ce-91d5-0a9e3a78821d {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-041ac209-8cad-4dee-93c0-b1eceb8aade7 tempest-VolumeDependencyTests-116051424 None] snapshot_file for this snap is: volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.b6e9b5c1-7a9a-46a9-8048-15f42599f5f7 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16ec16d-bd8a-4ce6-95a4-49b0ddd4bc6e]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-041ac209-8cad-4dee-93c0-b1eceb8aade7 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.b6e9b5c1-7a9a-46a9-8048-15f42599f5f7 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:00 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:00 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.b6e9b5c1-7a9a-46a9-8048-15f42599f5f7 Apr 15 20:15:00 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c" returned: 0 in 0.457s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.607s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1519081685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d0a5d7-e9ac-4feb-a39a-166585f8668f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bca39e0b413f463ba72f63b2e3c28155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:56Z,use_quota=True,user_id='679cde384c8148fd9df4cee5c5ffb6d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Creating volume 89d0a5d7-e9ac-4feb-a39a-166585f8668f {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:15:00 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-89d0a5d7-e9ac-4feb-a39a-166585f8668f 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (719f1dcd-ac5e-4dc0-b3f9-f8bbd156c6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad95f9b0-54a7-42da-9634-01b5b441c13c', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48a07cc-d3a3-4bc1-b93c-0f030f3f8376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:00 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-89d0a5d7-e9ac-4feb-a39a-166585f8668f 1073741824 Apr 15 20:15:00 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:00 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Volume volume-ad95f9b0-54a7-42da-9634-01b5b441c13c (ad95f9b0-54a7-42da-9634-01b5b441c13c): created successfully Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48a07cc-d3a3-4bc1-b93c-0f030f3f8376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Flow 'volume_create_manager' (8b2186d2-00a3-4236-98d1-e13347d1ac15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:00 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-96ea82f5-1fb6-42ed-97f1-21d78c5a47e7 tempest-SnapshotDependencyTests-617452826 None] Created volume successfully. Apr 15 20:15:00 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-041ac209-8cad-4dee-93c0-b1eceb8aade7 tempest-VolumeDependencyTests-116051424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.b6e9b5c1-7a9a-46a9-8048-15f42599f5f7" returned: 0 in 0.558s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-041ac209-8cad-4dee-93c0-b1eceb8aade7 tempest-VolumeDependencyTests-116051424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2262c7-24af-4a6e-8374-f26d7078e508]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:00 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-041ac209-8cad-4dee-93c0-b1eceb8aade7 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:01 devstack sudo[90629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d Apr 15 20:15:01 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:01 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-89d0a5d7-e9ac-4feb-a39a-166585f8668f 1073741824" returned: 0 in 0.536s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-89d0a5d7-e9ac-4feb-a39a-166585f8668f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:01 devstack sudo[90631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-89d0a5d7-e9ac-4feb-a39a-166585f8668f Apr 15 20:15:01 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8a4372b5-49df-45cc-b85a-38ddcf5fb195 tempest-SnapshotDependencyTests-617452826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:01 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-041ac209-8cad-4dee-93c0-b1eceb8aade7 tempest-VolumeDependencyTests-116051424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d" returned: 0 in 0.584s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-041ac209-8cad-4dee-93c0-b1eceb8aade7 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.b6e9b5c1-7a9a-46a9-8048-15f42599f5f7 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:01 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.b6e9b5c1-7a9a-46a9-8048-15f42599f5f7 Apr 15 20:15:01 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:01 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-89d0a5d7-e9ac-4feb-a39a-166585f8668f" returned: 0 in 0.576s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:01 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:15:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.543s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:01 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-40646175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061d110d-0f76-4246-a81a-3a2565f8b276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bca39e0b413f463ba72f63b2e3c28155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:56Z,use_quota=True,user_id='679cde384c8148fd9df4cee5c5ffb6d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:15:01 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Creating volume 061d110d-0f76-4246-a81a-3a2565f8b276 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:15:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:01 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:01 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:01 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:15:01 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:15:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-061d110d-0f76-4246-a81a-3a2565f8b276 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:01 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c847e8bc-0f15-4259-bc19-91a09ee7c47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89d0a5d7-e9ac-4feb-a39a-166585f8668f', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:01 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-061d110d-0f76-4246-a81a-3a2565f8b276 1073741824 Apr 15 20:15:01 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:01 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66839302-7ab5-463d-8618-1b8e170d3f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:01 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Volume volume-89d0a5d7-e9ac-4feb-a39a-166585f8668f (89d0a5d7-e9ac-4feb-a39a-166585f8668f): created successfully Apr 15 20:15:01 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66839302-7ab5-463d-8618-1b8e170d3f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:01 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Flow 'volume_create_manager' (f3f7e438-c72a-4c4f-9625-72cc17c31871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:01 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-13ada3bf-41c5-409f-ba2e-e19a80521a93 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Created volume successfully. Apr 15 20:15:01 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:01 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-041ac209-8cad-4dee-93c0-b1eceb8aade7 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.b6e9b5c1-7a9a-46a9-8048-15f42599f5f7" returned: 0 in 0.460s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-041ac209-8cad-4dee-93c0-b1eceb8aade7 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.b6e9b5c1-7a9a-46a9-8048-15f42599f5f7 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:02 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.b6e9b5c1-7a9a-46a9-8048-15f42599f5f7 Apr 15 20:15:02 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Flow 'volume_create_manager' (55f87371-26ba-4a08-a0f2-7ffa7b9fbf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d66ebf-dd51-4f7c-b7bb-42e028126c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d66ebf-dd51-4f7c-b7bb-42e028126c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-644153739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8dd781-3bc2-4cd8-9d48-63a973254830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4db362efe7474a82f143ebef950281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:15:02Z,use_quota=True,user_id='edeff680e2f64373a1e295253cc5611c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5811895-619d-4686-afe3-39c8ff80df7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5811895-619d-4686-afe3-39c8ff80df7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f932a67a-59fd-4b1f-93ff-73f1e1aa11f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f932a67a-59fd-4b1f-93ff-73f1e1aa11f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a8dd781-3bc2-4cd8-9d48-63a973254830', 'volume_name': 'volume-2a8dd781-3bc2-4cd8-9d48-63a973254830', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b1acf8-e4dc-4c98-8ffd-aab01cb54e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b1acf8-e4dc-4c98-8ffd-aab01cb54e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:02 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bd1a9cc-b96d-4ac9-9865-5a7cf5b28a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:02 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Volume 2a8dd781-3bc2-4cd8-9d48-63a973254830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a8dd781-3bc2-4cd8-9d48-63a973254830', 'volume_size': 1} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-061d110d-0f76-4246-a81a-3a2565f8b276 1073741824" returned: 0 in 0.609s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-061d110d-0f76-4246-a81a-3a2565f8b276 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:02 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-061d110d-0f76-4246-a81a-3a2565f8b276 Apr 15 20:15:02 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:02 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-041ac209-8cad-4dee-93c0-b1eceb8aade7 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d.b6e9b5c1-7a9a-46a9-8048-15f42599f5f7" returned: 0 in 0.471s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-041ac209-8cad-4dee-93c0-b1eceb8aade7 tempest-VolumeDependencyTests-116051424 None] Lock "cinder-quobyte-b6e9b5c1-7a9a-46a9-8048-15f42599f5f7" released by "_delete_snapshot" :: held 2.191s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-041ac209-8cad-4dee-93c0-b1eceb8aade7 tempest-VolumeDependencyTests-116051424 None] Lock "cinder-quobyte-ba9882e9-0897-42ce-91d5-0a9e3a78821d" released by "delete_snapshot" :: held 2.207s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-041ac209-8cad-4dee-93c0-b1eceb8aade7 tempest-VolumeDependencyTests-116051424 None] Created reservations ['d3c95b01-eb33-467d-9d54-b1cc0836ae08', 'c92e4bb7-478f-4625-8a11-55add7c49633', '8ae7af26-4864-4fc1-8883-8ff7762582ac', '5ba53f37-1ca8-4ad4-9e76-e34e98dd08b6'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:02 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-041ac209-8cad-4dee-93c0-b1eceb8aade7 tempest-VolumeDependencyTests-116051424 None] Delete snapshot completed successfully. Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-041ac209-8cad-4dee-93c0-b1eceb8aade7 tempest-VolumeDependencyTests-116051424 None] Lock "cinder-b6e9b5c1-7a9a-46a9-8048-15f42599f5f7-delete_snapshot" released by "delete_snapshot" :: held 2.294s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:02 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-061d110d-0f76-4246-a81a-3a2565f8b276" returned: 0 in 0.427s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.412s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1587207672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1abf425-5a11-44b8-a3bc-0832867526cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bca39e0b413f463ba72f63b2e3c28155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:56Z,use_quota=True,user_id='679cde384c8148fd9df4cee5c5ffb6d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Creating volume f1abf425-5a11-44b8-a3bc-0832867526cb {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:15:02 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1abf425-5a11-44b8-a3bc-0832867526cb 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:02 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1abf425-5a11-44b8-a3bc-0832867526cb 1073741824 Apr 15 20:15:02 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06881c45-ed59-4599-ab8c-93c90736a798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-061d110d-0f76-4246-a81a-3a2565f8b276', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e8cada-9968-490b-b16e-bd0a17494c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:02 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Volume volume-061d110d-0f76-4246-a81a-3a2565f8b276 (061d110d-0f76-4246-a81a-3a2565f8b276): created successfully Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e8cada-9968-490b-b16e-bd0a17494c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:02 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Flow 'volume_create_manager' (c15ad370-01bf-4ced-b543-0a294de0e760) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:02 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-4bb65443-5cec-44c3-86c4-d0515ce3c48f tempest-CreateVolumesFromSnapshotTest-1008667287 None] Created volume successfully. Apr 15 20:15:03 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1abf425-5a11-44b8-a3bc-0832867526cb 1073741824" returned: 0 in 0.504s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1abf425-5a11-44b8-a3bc-0832867526cb {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:03 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1abf425-5a11-44b8-a3bc-0832867526cb Apr 15 20:15:03 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-673b6b8f-b2bf-4526-ba44-5038ef1cdf45 tempest-VolumeDependencyTests-116051424 None] Acquiring lock "cinder-ba9882e9-0897-42ce-91d5-0a9e3a78821d-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-673b6b8f-b2bf-4526-ba44-5038ef1cdf45 tempest-VolumeDependencyTests-116051424 None] Lock "cinder-ba9882e9-0897-42ce-91d5-0a9e3a78821d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-673b6b8f-b2bf-4526-ba44-5038ef1cdf45 tempest-VolumeDependencyTests-116051424 None] Acquiring lock "cinder-quobyte-ba9882e9-0897-42ce-91d5-0a9e3a78821d" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-673b6b8f-b2bf-4526-ba44-5038ef1cdf45 tempest-VolumeDependencyTests-116051424 None] Lock "cinder-quobyte-ba9882e9-0897-42ce-91d5-0a9e3a78821d" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb55a8b7-e23c-49bd-8d57-24b06010de32]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-673b6b8f-b2bf-4526-ba44-5038ef1cdf45 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:03 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d Apr 15 20:15:03 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:03 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1abf425-5a11-44b8-a3bc-0832867526cb" returned: 0 in 0.423s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.152s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-341991513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18d2971-9f99-4dc2-9c76-2dcc12e80d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bca39e0b413f463ba72f63b2e3c28155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:56Z,use_quota=True,user_id='679cde384c8148fd9df4cee5c5ffb6d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Creating volume b18d2971-9f99-4dc2-9c76-2dcc12e80d57 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:15:03 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b18d2971-9f99-4dc2-9c76-2dcc12e80d57 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384a67c6-7318-4fd7-b521-9cebcbc91fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1abf425-5a11-44b8-a3bc-0832867526cb', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:03 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b18d2971-9f99-4dc2-9c76-2dcc12e80d57 1073741824 Apr 15 20:15:03 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b055333-ea87-4a76-95df-7d2854c1d354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:03 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Volume volume-f1abf425-5a11-44b8-a3bc-0832867526cb (f1abf425-5a11-44b8-a3bc-0832867526cb): created successfully Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b055333-ea87-4a76-95df-7d2854c1d354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:03 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Flow 'volume_create_manager' (89b3a1dd-07cd-4b20-a2d3-1b60c8250599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:03 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-61596789-6271-4be7-945d-9b14684ba034 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Created volume successfully. Apr 15 20:15:04 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-673b6b8f-b2bf-4526-ba44-5038ef1cdf45 tempest-VolumeDependencyTests-116051424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d" returned: 0 in 0.480s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-673b6b8f-b2bf-4526-ba44-5038ef1cdf45 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:04 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d Apr 15 20:15:04 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:04 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b18d2971-9f99-4dc2-9c76-2dcc12e80d57 1073741824" returned: 0 in 0.504s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b18d2971-9f99-4dc2-9c76-2dcc12e80d57 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:04 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b18d2971-9f99-4dc2-9c76-2dcc12e80d57 Apr 15 20:15:04 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:04 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-673b6b8f-b2bf-4526-ba44-5038ef1cdf45 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ba9882e9-0897-42ce-91d5-0a9e3a78821d" returned: 0 in 0.434s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-673b6b8f-b2bf-4526-ba44-5038ef1cdf45 tempest-VolumeDependencyTests-116051424 None] Lock "cinder-quobyte-ba9882e9-0897-42ce-91d5-0a9e3a78821d" released by "delete_volume" :: held 0.958s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-673b6b8f-b2bf-4526-ba44-5038ef1cdf45 tempest-VolumeDependencyTests-116051424 None] Created reservations ['33a3b529-16a2-4fd9-aead-317a460cc5a9', '6ceeca05-6010-472b-bd46-d697d1451e32', '34c619e6-fd56-41d7-9f21-1b13f923e076', 'a041b3a0-ecdb-4586-92d8-3585abbd9fc6'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-673b6b8f-b2bf-4526-ba44-5038ef1cdf45 tempest-VolumeDependencyTests-116051424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-673b6b8f-b2bf-4526-ba44-5038ef1cdf45 tempest-VolumeDependencyTests-116051424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-673b6b8f-b2bf-4526-ba44-5038ef1cdf45 tempest-VolumeDependencyTests-116051424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-673b6b8f-b2bf-4526-ba44-5038ef1cdf45 tempest-VolumeDependencyTests-116051424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-673b6b8f-b2bf-4526-ba44-5038ef1cdf45 tempest-VolumeDependencyTests-116051424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-673b6b8f-b2bf-4526-ba44-5038ef1cdf45 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:04 devstack sudo[90677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:15:04 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:04 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b18d2971-9f99-4dc2-9c76-2dcc12e80d57" returned: 0 in 0.514s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.884s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1221982827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aae6db2-4e66-4f6b-93e6-3477052e36eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bca39e0b413f463ba72f63b2e3c28155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:14:57Z,use_quota=True,user_id='679cde384c8148fd9df4cee5c5ffb6d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Creating volume 7aae6db2-4e66-4f6b-93e6-3477052e36eb {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:15:04 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7aae6db2-4e66-4f6b-93e6-3477052e36eb 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13089e0d-6e27-400f-b3ef-2b55869def4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18d2971-9f99-4dc2-9c76-2dcc12e80d57', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33cebfed-b085-4198-acab-521bbe019e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:04 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Volume volume-b18d2971-9f99-4dc2-9c76-2dcc12e80d57 (b18d2971-9f99-4dc2-9c76-2dcc12e80d57): created successfully Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33cebfed-b085-4198-acab-521bbe019e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:04 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7aae6db2-4e66-4f6b-93e6-3477052e36eb 1073741824 Apr 15 20:15:04 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Flow 'volume_create_manager' (8385353b-fffc-4e7d-b280-4e03da685bb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:04 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-0178d8f2-68f5-47ff-bee7-7ae5c7d0a378 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Created volume successfully. Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Flow 'volume_create_manager' (1ad250b3-7cc1-4cb4-be4e-bdb1fe9a1a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d13c30-0e40-424e-8aa8-dd97f3752fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d13c30-0e40-424e-8aa8-dd97f3752fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1791149655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f117bd-573e-467b-a15c-5441a87ca73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca62bf5cd72487c9bc3e4103ad1e30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:15:05Z,use_quota=True,user_id='db99822632054502994d318bed45b069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f5bdb6e-841a-472b-8f90-7c03589a07b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f5bdb6e-841a-472b-8f90-7c03589a07b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a02744b-1c85-48f2-a7c7-09c94a3de8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a02744b-1c85-48f2-a7c7-09c94a3de8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88f117bd-573e-467b-a15c-5441a87ca73e', 'volume_name': 'volume-88f117bd-573e-467b-a15c-5441a87ca73e', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df7ab660-7b07-4e9d-abf1-7dca234eccb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df7ab660-7b07-4e9d-abf1-7dca234eccb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43093b03-5c13-4e9d-bee1-5acbec68a18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:04 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Volume 88f117bd-573e-467b-a15c-5441a87ca73e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88f117bd-573e-467b-a15c-5441a87ca73e', 'volume_size': 1} Apr 15 20:15:04 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:05 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-673b6b8f-b2bf-4526-ba44-5038ef1cdf45 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.473s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:05 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-673b6b8f-b2bf-4526-ba44-5038ef1cdf45 tempest-VolumeDependencyTests-116051424 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:15:05 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-673b6b8f-b2bf-4526-ba44-5038ef1cdf45 tempest-VolumeDependencyTests-116051424 None] Deleted volume successfully. Apr 15 20:15:05 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-673b6b8f-b2bf-4526-ba44-5038ef1cdf45 tempest-VolumeDependencyTests-116051424 None] Lock "cinder-ba9882e9-0897-42ce-91d5-0a9e3a78821d-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:05 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7aae6db2-4e66-4f6b-93e6-3477052e36eb 1073741824" returned: 0 in 0.581s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7aae6db2-4e66-4f6b-93e6-3477052e36eb {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:05 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7aae6db2-4e66-4f6b-93e6-3477052e36eb Apr 15 20:15:05 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:05 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7aae6db2-4e66-4f6b-93e6-3477052e36eb" returned: 0 in 0.431s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:15:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8a4372b5-49df-45cc-b85a-38ddcf5fb195 tempest-SnapshotDependencyTests-617452826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.477s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c85497-9602-4ce3-8391-89d7ed7e7283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aae6db2-4e66-4f6b-93e6-3477052e36eb', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79bab132-8871-4d86-8156-85807b5a5576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:05 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-8a4372b5-49df-45cc-b85a-38ddcf5fb195 tempest-SnapshotDependencyTests-617452826 None] Creating offline snapshot f54e7b06-cf38-43a6-b6ed-b3d83abd5841 of volume ad95f9b0-54a7-42da-9634-01b5b441c13c {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:15:05 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Volume volume-7aae6db2-4e66-4f6b-93e6-3477052e36eb (7aae6db2-4e66-4f6b-93e6-3477052e36eb): created successfully Apr 15 20:15:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79bab132-8871-4d86-8156-85807b5a5576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:05 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Flow 'volume_create_manager' (33d9d52f-60a2-418b-9e80-9c85a421b4d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:05 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd98c255-034f-46db-9881-23aa31cb5929]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:05 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8a4372b5-49df-45cc-b85a-38ddcf5fb195 tempest-SnapshotDependencyTests-617452826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:05 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-554b4ff4-9af0-4b7f-b48e-74e808a21107 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Created volume successfully. Apr 15 20:15:05 devstack sudo[90689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c Apr 15 20:15:05 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:06 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8a4372b5-49df-45cc-b85a-38ddcf5fb195 tempest-SnapshotDependencyTests-617452826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c" returned: 0 in 0.495s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8a4372b5-49df-45cc-b85a-38ddcf5fb195 tempest-SnapshotDependencyTests-617452826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.f54e7b06-cf38-43a6-b6ed-b3d83abd5841 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:06 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.f54e7b06-cf38-43a6-b6ed-b3d83abd5841 1G Apr 15 20:15:06 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:06 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-0bc95e22-babf-45dd-aeb7-912fba9a8b4a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "cinder-7aae6db2-4e66-4f6b-93e6-3477052e36eb-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:06 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-0bc95e22-babf-45dd-aeb7-912fba9a8b4a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-7aae6db2-4e66-4f6b-93e6-3477052e36eb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:06 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-0bc95e22-babf-45dd-aeb7-912fba9a8b4a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "cinder-quobyte-7aae6db2-4e66-4f6b-93e6-3477052e36eb" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:06 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-0bc95e22-babf-45dd-aeb7-912fba9a8b4a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-quobyte-7aae6db2-4e66-4f6b-93e6-3477052e36eb" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:06 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df8f8fc-5aee-40c6-b837-4f8c66931ba5]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0bc95e22-babf-45dd-aeb7-912fba9a8b4a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7aae6db2-4e66-4f6b-93e6-3477052e36eb {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:06 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7aae6db2-4e66-4f6b-93e6-3477052e36eb Apr 15 20:15:06 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:06 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8a4372b5-49df-45cc-b85a-38ddcf5fb195 tempest-SnapshotDependencyTests-617452826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.f54e7b06-cf38-43a6-b6ed-b3d83abd5841 1G" returned: 0 in 0.519s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:06 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8a4372b5-49df-45cc-b85a-38ddcf5fb195 tempest-SnapshotDependencyTests-617452826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad95f9b0-54a7-42da-9634-01b5b441c13c -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.f54e7b06-cf38-43a6-b6ed-b3d83abd5841 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:06 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad95f9b0-54a7-42da-9634-01b5b441c13c -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.f54e7b06-cf38-43a6-b6ed-b3d83abd5841 Apr 15 20:15:06 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:07 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0bc95e22-babf-45dd-aeb7-912fba9a8b4a tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7aae6db2-4e66-4f6b-93e6-3477052e36eb" returned: 0 in 0.468s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0bc95e22-babf-45dd-aeb7-912fba9a8b4a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7aae6db2-4e66-4f6b-93e6-3477052e36eb {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:07 devstack sudo[90706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7aae6db2-4e66-4f6b-93e6-3477052e36eb Apr 15 20:15:07 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:07 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8a4372b5-49df-45cc-b85a-38ddcf5fb195 tempest-SnapshotDependencyTests-617452826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad95f9b0-54a7-42da-9634-01b5b441c13c -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.f54e7b06-cf38-43a6-b6ed-b3d83abd5841" returned: 0 in 0.432s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:07 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-8a4372b5-49df-45cc-b85a-38ddcf5fb195 tempest-SnapshotDependencyTests-617452826 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.f54e7b06-cf38-43a6-b6ed-b3d83abd5841 is being set with open permissions: ugo+rw Apr 15 20:15:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8a4372b5-49df-45cc-b85a-38ddcf5fb195 tempest-SnapshotDependencyTests-617452826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.f54e7b06-cf38-43a6-b6ed-b3d83abd5841 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:07 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.f54e7b06-cf38-43a6-b6ed-b3d83abd5841 Apr 15 20:15:07 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:07 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0bc95e22-babf-45dd-aeb7-912fba9a8b4a tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-7aae6db2-4e66-4f6b-93e6-3477052e36eb" returned: 0 in 0.406s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:07 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-0bc95e22-babf-45dd-aeb7-912fba9a8b4a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-quobyte-7aae6db2-4e66-4f6b-93e6-3477052e36eb" released by "delete_volume" :: held 0.895s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:07 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-0bc95e22-babf-45dd-aeb7-912fba9a8b4a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Created reservations ['75d5eac6-2e2a-4e15-a401-bb794d52fad4', '775859b6-8c66-44bc-849c-f5f8c22243d8', '66baa37d-57e2-48a8-9d5d-121c57902ba2', '5d13cc88-7bab-4f5f-b6f5-2251cb8308ed'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0bc95e22-babf-45dd-aeb7-912fba9a8b4a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0bc95e22-babf-45dd-aeb7-912fba9a8b4a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:07 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0bc95e22-babf-45dd-aeb7-912fba9a8b4a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:07 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-0bc95e22-babf-45dd-aeb7-912fba9a8b4a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-0bc95e22-babf-45dd-aeb7-912fba9a8b4a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0bc95e22-babf-45dd-aeb7-912fba9a8b4a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:07 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:15:07 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:07 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-38e52204-bdeb-40bf-8c7b-07c235d881ad tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "cinder-b18d2971-9f99-4dc2-9c76-2dcc12e80d57-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:07 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-38e52204-bdeb-40bf-8c7b-07c235d881ad tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-b18d2971-9f99-4dc2-9c76-2dcc12e80d57-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:07 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-38e52204-bdeb-40bf-8c7b-07c235d881ad tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "cinder-quobyte-b18d2971-9f99-4dc2-9c76-2dcc12e80d57" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:07 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-38e52204-bdeb-40bf-8c7b-07c235d881ad tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-quobyte-b18d2971-9f99-4dc2-9c76-2dcc12e80d57" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:07 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24f8458-d13f-4c7d-aa5e-b434babfdedb]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-38e52204-bdeb-40bf-8c7b-07c235d881ad tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b18d2971-9f99-4dc2-9c76-2dcc12e80d57 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:07 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8a4372b5-49df-45cc-b85a-38ddcf5fb195 tempest-SnapshotDependencyTests-617452826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.f54e7b06-cf38-43a6-b6ed-b3d83abd5841" returned: 0 in 0.434s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:07 devstack sudo[90717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b18d2971-9f99-4dc2-9c76-2dcc12e80d57 Apr 15 20:15:07 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8a4372b5-49df-45cc-b85a-38ddcf5fb195 tempest-SnapshotDependencyTests-617452826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:07 devstack sudo[90719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.info Apr 15 20:15:07 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:07 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:07 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-0bc95e22-babf-45dd-aeb7-912fba9a8b4a tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.454s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:07 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-0bc95e22-babf-45dd-aeb7-912fba9a8b4a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:15:07 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-0bc95e22-babf-45dd-aeb7-912fba9a8b4a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Deleted volume successfully. Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-0bc95e22-babf-45dd-aeb7-912fba9a8b4a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-7aae6db2-4e66-4f6b-93e6-3477052e36eb-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:08 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-38e52204-bdeb-40bf-8c7b-07c235d881ad tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b18d2971-9f99-4dc2-9c76-2dcc12e80d57" returned: 0 in 0.492s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-38e52204-bdeb-40bf-8c7b-07c235d881ad tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b18d2971-9f99-4dc2-9c76-2dcc12e80d57 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:08 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b18d2971-9f99-4dc2-9c76-2dcc12e80d57 Apr 15 20:15:08 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:08 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8a4372b5-49df-45cc-b85a-38ddcf5fb195 tempest-SnapshotDependencyTests-617452826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.info" returned: 0 in 0.416s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:08 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-8a4372b5-49df-45cc-b85a-38ddcf5fb195 tempest-SnapshotDependencyTests-617452826 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.info is being set with open permissions: ugo+rw Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8a4372b5-49df-45cc-b85a-38ddcf5fb195 tempest-SnapshotDependencyTests-617452826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:08 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.info Apr 15 20:15:08 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:08 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-38e52204-bdeb-40bf-8c7b-07c235d881ad tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-b18d2971-9f99-4dc2-9c76-2dcc12e80d57" returned: 0 in 0.394s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-38e52204-bdeb-40bf-8c7b-07c235d881ad tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-quobyte-b18d2971-9f99-4dc2-9c76-2dcc12e80d57" released by "delete_volume" :: held 0.907s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-38e52204-bdeb-40bf-8c7b-07c235d881ad tempest-CreateVolumesFromSnapshotTest-1008667287 None] Created reservations ['ea66f3ed-0878-44a6-a45b-90c34bcdb0ab', '4c486dd2-f6b8-4200-a079-d1509517eb4d', '881dde5b-3b59-49ea-8d84-5c3a60e13088', 'd343d729-4a32-40ea-9aee-950e099ba43c'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:08 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8a4372b5-49df-45cc-b85a-38ddcf5fb195 tempest-SnapshotDependencyTests-617452826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.info" returned: 0 in 0.419s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8a4372b5-49df-45cc-b85a-38ddcf5fb195 tempest-SnapshotDependencyTests-617452826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.814s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.366s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-644153739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8dd781-3bc2-4cd8-9d48-63a973254830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4db362efe7474a82f143ebef950281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:15:02Z,use_quota=True,user_id='edeff680e2f64373a1e295253cc5611c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Creating volume 2a8dd781-3bc2-4cd8-9d48-63a973254830 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:15:08 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2a8dd781-3bc2-4cd8-9d48-63a973254830 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:08 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2a8dd781-3bc2-4cd8-9d48-63a973254830 1073741824 Apr 15 20:15:08 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:08 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-8a4372b5-49df-45cc-b85a-38ddcf5fb195 tempest-SnapshotDependencyTests-617452826 None] Create snapshot completed successfully Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-38e52204-bdeb-40bf-8c7b-07c235d881ad tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-38e52204-bdeb-40bf-8c7b-07c235d881ad tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-38e52204-bdeb-40bf-8c7b-07c235d881ad tempest-CreateVolumesFromSnapshotTest-1008667287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-38e52204-bdeb-40bf-8c7b-07c235d881ad tempest-CreateVolumesFromSnapshotTest-1008667287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-38e52204-bdeb-40bf-8c7b-07c235d881ad tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-38e52204-bdeb-40bf-8c7b-07c235d881ad tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:08 devstack sudo[90734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:15:08 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7003932e-9e3e-4908-93cb-c6b345a2574a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "cinder-f1abf425-5a11-44b8-a3bc-0832867526cb-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7003932e-9e3e-4908-93cb-c6b345a2574a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-f1abf425-5a11-44b8-a3bc-0832867526cb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7003932e-9e3e-4908-93cb-c6b345a2574a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "cinder-quobyte-f1abf425-5a11-44b8-a3bc-0832867526cb" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7003932e-9e3e-4908-93cb-c6b345a2574a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-quobyte-f1abf425-5a11-44b8-a3bc-0832867526cb" acquired by "delete_volume" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[1857248f-1269-4142-9886-2a865c433f1b]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:08 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7003932e-9e3e-4908-93cb-c6b345a2574a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1abf425-5a11-44b8-a3bc-0832867526cb {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:08 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1abf425-5a11-44b8-a3bc-0832867526cb Apr 15 20:15:08 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:09 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-38e52204-bdeb-40bf-8c7b-07c235d881ad tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.429s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-38e52204-bdeb-40bf-8c7b-07c235d881ad tempest-CreateVolumesFromSnapshotTest-1008667287 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:15:09 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-38e52204-bdeb-40bf-8c7b-07c235d881ad tempest-CreateVolumesFromSnapshotTest-1008667287 None] Deleted volume successfully. Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-38e52204-bdeb-40bf-8c7b-07c235d881ad tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-b18d2971-9f99-4dc2-9c76-2dcc12e80d57-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:09 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2a8dd781-3bc2-4cd8-9d48-63a973254830 1073741824" returned: 0 in 0.517s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2a8dd781-3bc2-4cd8-9d48-63a973254830 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:09 devstack sudo[90742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2a8dd781-3bc2-4cd8-9d48-63a973254830 Apr 15 20:15:09 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:09 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7003932e-9e3e-4908-93cb-c6b345a2574a tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1abf425-5a11-44b8-a3bc-0832867526cb" returned: 0 in 0.503s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7003932e-9e3e-4908-93cb-c6b345a2574a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1abf425-5a11-44b8-a3bc-0832867526cb {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:09 devstack sudo[90747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1abf425-5a11-44b8-a3bc-0832867526cb Apr 15 20:15:09 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:09 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2a8dd781-3bc2-4cd8-9d48-63a973254830" returned: 0 in 0.427s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.665s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1791149655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f117bd-573e-467b-a15c-5441a87ca73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca62bf5cd72487c9bc3e4103ad1e30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:15:05Z,use_quota=True,user_id='db99822632054502994d318bed45b069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Creating volume 88f117bd-573e-467b-a15c-5441a87ca73e {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:15:09 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bd1a9cc-b96d-4ac9-9865-5a7cf5b28a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a8dd781-3bc2-4cd8-9d48-63a973254830', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a56b686-d0b4-4f96-8bfd-9d69570d8f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:09 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e 1073741824 Apr 15 20:15:09 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:09 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Volume volume-2a8dd781-3bc2-4cd8-9d48-63a973254830 (2a8dd781-3bc2-4cd8-9d48-63a973254830): created successfully Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a56b686-d0b4-4f96-8bfd-9d69570d8f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Flow 'volume_create_manager' (55f87371-26ba-4a08-a0f2-7ffa7b9fbf77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:09 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-c66cbfab-d6b2-43be-afe8-1e4d52ebb83f tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Created volume successfully. Apr 15 20:15:09 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7003932e-9e3e-4908-93cb-c6b345a2574a tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f1abf425-5a11-44b8-a3bc-0832867526cb" returned: 0 in 0.462s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7003932e-9e3e-4908-93cb-c6b345a2574a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-quobyte-f1abf425-5a11-44b8-a3bc-0832867526cb" released by "delete_volume" :: held 0.996s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-7003932e-9e3e-4908-93cb-c6b345a2574a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Created reservations ['b03720eb-5136-41bd-8666-e0324604a2c3', '2ca17ce6-a7e4-40c0-b07c-24aede167a1e', '8fb80c59-506f-41e8-84e4-abdef8478c97', '9206d92c-8d02-4cde-b180-bf0c9f5e1f6c'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7003932e-9e3e-4908-93cb-c6b345a2574a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7003932e-9e3e-4908-93cb-c6b345a2574a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7003932e-9e3e-4908-93cb-c6b345a2574a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7003932e-9e3e-4908-93cb-c6b345a2574a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7003932e-9e3e-4908-93cb-c6b345a2574a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7003932e-9e3e-4908-93cb-c6b345a2574a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:15:09 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:15:09 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:09 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Flow 'volume_create_manager' (ec825f0b-55b7-4aa4-b9ec-f2ffa5d613db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f069c5de-8ae0-44fa-8cc9-365dfee2e700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f069c5de-8ae0-44fa-8cc9-365dfee2e700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23819005-d2e4-444c-a0ce-ce8329d46ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c5d7561f2bc422d8751e3eb688f716b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f54e7b06-cf38-43a6-b6ed-b3d83abd5841,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:15:10Z,use_quota=True,user_id='3481e4c1d35f443b98ee1664be97caaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd7d5081-c1a0-4129-baa5-a989ae6f433a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd7d5081-c1a0-4129-baa5-a989ae6f433a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9aae19a-46ed-4b40-ad3b-3e2b6a6f70fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9aae19a-46ed-4b40-ad3b-3e2b6a6f70fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '23819005-d2e4-444c-a0ce-ce8329d46ca6', 'volume_name': 'volume-23819005-d2e4-444c-a0ce-ce8329d46ca6', 'volume_size': 1, 'snapshot_id': 'f54e7b06-cf38-43a6-b6ed-b3d83abd5841'}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33efb829-fd7c-4154-892c-ab8debb6004e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33efb829-fd7c-4154-892c-ab8debb6004e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3c4d1d-cbf1-42e4-adb9-581a6167bf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:10 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Volume 23819005-d2e4-444c-a0ce-ce8329d46ca6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-23819005-d2e4-444c-a0ce-ce8329d46ca6', 'volume_size': 1, 'snapshot_id': 'f54e7b06-cf38-43a6-b6ed-b3d83abd5841'} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:10 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e 1073741824" returned: 0 in 0.591s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:10 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e Apr 15 20:15:10 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:10 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7003932e-9e3e-4908-93cb-c6b345a2574a tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.433s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-7003932e-9e3e-4908-93cb-c6b345a2574a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:15:10 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-7003932e-9e3e-4908-93cb-c6b345a2574a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Deleted volume successfully. Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7003932e-9e3e-4908-93cb-c6b345a2574a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-f1abf425-5a11-44b8-a3bc-0832867526cb-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:10 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e" returned: 0 in 0.414s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.589s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Acquiring lock "cinder-quobyte-f54e7b06-cf38-43a6-b6ed-b3d83abd5841-23819005-d2e4-444c-a0ce-ce8329d46ca6" by "_create_volume_from_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43093b03-5c13-4e9d-bee1-5acbec68a18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88f117bd-573e-467b-a15c-5441a87ca73e', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b9a36b-a72f-4fbf-9f6c-171773ae6806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Lock "cinder-quobyte-f54e7b06-cf38-43a6-b6ed-b3d83abd5841-23819005-d2e4-444c-a0ce-ce8329d46ca6" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Creating volume 23819005-d2e4-444c-a0ce-ce8329d46ca6 from snapshot f54e7b06-cf38-43a6-b6ed-b3d83abd5841 {{(pid=82989) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Acquiring lock "cinder-quobyte-23819005-d2e4-444c-a0ce-ce8329d46ca6" by "_copy_volume_from_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:10 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Volume volume-88f117bd-573e-467b-a15c-5441a87ca73e (88f117bd-573e-467b-a15c-5441a87ca73e): created successfully Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b9a36b-a72f-4fbf-9f6c-171773ae6806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Flow 'volume_create_manager' (1ad250b3-7cc1-4cb4-be4e-bdb1fe9a1a18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Lock "cinder-quobyte-23819005-d2e4-444c-a0ce-ce8329d46ca6" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] snapshot: f54e7b06-cf38-43a6-b6ed-b3d83abd5841, volume: 23819005-d2e4-444c-a0ce-ce8329d46ca6, {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 20:15:10 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-b849d27a-d433-4dfa-84be-ef9e1f5835a4 tempest-VolumeDependencyTests-116051424 None] Created volume successfully. Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bf8f76-f513-4e76-9f30-6e44215d9375]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.f54e7b06-cf38-43a6-b6ed-b3d83abd5841 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Flow 'volume_create_manager' (eafce39b-02e1-40a0-b42f-af6efe5066a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a441052-fa50-446b-a12f-f0f20ba8c6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:10 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.f54e7b06-cf38-43a6-b6ed-b3d83abd5841 Apr 15 20:15:10 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a441052-fa50-446b-a12f-f0f20ba8c6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-999487610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f90c13-964d-4ab8-8e94-529669bcafed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4db362efe7474a82f143ebef950281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:15:11Z,use_quota=True,user_id='edeff680e2f64373a1e295253cc5611c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (208de1c1-81bf-470a-9969-3b769ba70d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (208de1c1-81bf-470a-9969-3b769ba70d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b682189b-cd21-40d8-84fd-5090ca0a286a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b682189b-cd21-40d8-84fd-5090ca0a286a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57f90c13-964d-4ab8-8e94-529669bcafed', 'volume_name': 'volume-57f90c13-964d-4ab8-8e94-529669bcafed', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c934d9fb-e2da-4975-97e8-1be55f8952c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c934d9fb-e2da-4975-97e8-1be55f8952c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97117634-42ac-46ff-8370-27000b9f4cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:10 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Volume 57f90c13-964d-4ab8-8e94-529669bcafed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57f90c13-964d-4ab8-8e94-529669bcafed', 'volume_size': 1} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-c6576fd7-9920-469d-aed0-7bbb9d0f0d2c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "cinder-061d110d-0f76-4246-a81a-3a2565f8b276-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-c6576fd7-9920-469d-aed0-7bbb9d0f0d2c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-061d110d-0f76-4246-a81a-3a2565f8b276-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:10 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Flow 'volume_create_manager' (fe7c4510-f264-491a-a886-8f987c7d0062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e10b28-15b3-4026-9f9d-f8940dfcb8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-c6576fd7-9920-469d-aed0-7bbb9d0f0d2c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "cinder-quobyte-061d110d-0f76-4246-a81a-3a2565f8b276" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e10b28-15b3-4026-9f9d-f8940dfcb8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2073262099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fb711e3-aa1d-4c42-9674-a133a689a445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4db362efe7474a82f143ebef950281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:15:11Z,use_quota=True,user_id='edeff680e2f64373a1e295253cc5611c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa89e9c-f1df-45c1-aa7b-82fdbb778214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa89e9c-f1df-45c1-aa7b-82fdbb778214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874d1fc0-c70c-40af-a884-b8e62696c008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874d1fc0-c70c-40af-a884-b8e62696c008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fb711e3-aa1d-4c42-9674-a133a689a445', 'volume_name': 'volume-0fb711e3-aa1d-4c42-9674-a133a689a445', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a029c364-734a-435a-afe2-19b1e2ce5338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a029c364-734a-435a-afe2-19b1e2ce5338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6f9c28-6ca7-447e-ad09-e946f5bdc540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Volume 0fb711e3-aa1d-4c42-9674-a133a689a445: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fb711e3-aa1d-4c42-9674-a133a689a445', 'volume_size': 1} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-c6576fd7-9920-469d-aed0-7bbb9d0f0d2c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-quobyte-061d110d-0f76-4246-a81a-3a2565f8b276" acquired by "delete_volume" :: waited 0.041s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c396c9c-1048-440c-939d-e4055b490e12]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c6576fd7-9920-469d-aed0-7bbb9d0f0d2c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-061d110d-0f76-4246-a81a-3a2565f8b276 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:11 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-061d110d-0f76-4246-a81a-3a2565f8b276 Apr 15 20:15:11 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Flow 'volume_create_manager' (d094209e-e06c-479e-8525-0bf25382cb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7576a2e-0a55-4c67-8ce9-f724ac9404b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7576a2e-0a55-4c67-8ce9-f724ac9404b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1111700818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8acecbe5-fb92-414a-a87f-73eac1af3676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4db362efe7474a82f143ebef950281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:15:11Z,use_quota=True,user_id='edeff680e2f64373a1e295253cc5611c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ed41c2-61b9-4c2f-85de-4d07f600f3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ed41c2-61b9-4c2f-85de-4d07f600f3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188c4017-8609-4e17-bcf7-41a5c8d0ea01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188c4017-8609-4e17-bcf7-41a5c8d0ea01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8acecbe5-fb92-414a-a87f-73eac1af3676', 'volume_name': 'volume-8acecbe5-fb92-414a-a87f-73eac1af3676', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f0fd0a-6398-433e-bb02-74153e41cb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f0fd0a-6398-433e-bb02-74153e41cb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d566082-25e9-44c1-98d0-ab41e79981e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Volume 8acecbe5-fb92-414a-a87f-73eac1af3676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8acecbe5-fb92-414a-a87f-73eac1af3676', 'volume_size': 1} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:11 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.f54e7b06-cf38-43a6-b6ed-b3d83abd5841" returned: 0 in 0.693s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad95f9b0-54a7-42da-9634-01b5b441c13c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Creating direct copy from snapshot {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedf6e59-cfb3-4b2e-9ad2-3b5b61d2c487]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:11 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c Apr 15 20:15:11 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Flow 'volume_create_manager' (fab4c1b2-9631-4e7b-955e-212d43c5aec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d962f7d-701b-4735-9a68-e97ae60db248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Flow 'volume_create_manager' (16664e99-9df8-4cf2-afb8-4e18500f7257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1ccdf1-e113-438a-80c2-e3cc0f9839eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d962f7d-701b-4735-9a68-e97ae60db248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2013586018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=157e3e18-ea02-4d75-8b53-5e6258d3f7b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4db362efe7474a82f143ebef950281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:15:12Z,use_quota=True,user_id='edeff680e2f64373a1e295253cc5611c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a884182-da7b-44ed-9917-03940083753d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a884182-da7b-44ed-9917-03940083753d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b518af0-a139-47f6-8c02-5b24b1d19ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b518af0-a139-47f6-8c02-5b24b1d19ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '157e3e18-ea02-4d75-8b53-5e6258d3f7b2', 'volume_name': 'volume-157e3e18-ea02-4d75-8b53-5e6258d3f7b2', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79110595-4c71-4c0c-8886-b33a8499a7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79110595-4c71-4c0c-8886-b33a8499a7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed2b0e9-fd13-4471-a5c6-153eabc3fba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Volume 157e3e18-ea02-4d75-8b53-5e6258d3f7b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-157e3e18-ea02-4d75-8b53-5e6258d3f7b2', 'volume_size': 1} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1ccdf1-e113-438a-80c2-e3cc0f9839eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1906588143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0407c8b3-7c2a-47f8-96aa-2b41f91488b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca62bf5cd72487c9bc3e4103ad1e30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=88f117bd-573e-467b-a15c-5441a87ca73e,status='creating',terminated_at=None,updated_at=2026-04-15T18:15:11Z,use_quota=True,user_id='db99822632054502994d318bed45b069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a387b137-5f13-4bba-aa02-6fae8531ebed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a387b137-5f13-4bba-aa02-6fae8531ebed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20807bd-2538-4acb-a925-e57f22b7cd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Flow 'volume_create_manager' (4d9a3bc1-a57f-4b5a-9a9b-2784ca482255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037cdf33-cd61-45dc-b605-7a589323b1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037cdf33-cd61-45dc-b605-7a589323b1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-667325992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13d0ef3-0d6a-4121-bb16-c3e5efa249c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4db362efe7474a82f143ebef950281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:15:12Z,use_quota=True,user_id='edeff680e2f64373a1e295253cc5611c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd28877-0d1d-46c7-903b-f8f1e109186a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd28877-0d1d-46c7-903b-f8f1e109186a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f79fd3-8a0a-4c5e-ad1d-685bdb4215ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f79fd3-8a0a-4c5e-ad1d-685bdb4215ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f13d0ef3-0d6a-4121-bb16-c3e5efa249c5', 'volume_name': 'volume-f13d0ef3-0d6a-4121-bb16-c3e5efa249c5', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55a9107-2896-4d47-b1d6-9082aeb92c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55a9107-2896-4d47-b1d6-9082aeb92c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6e6127-7e74-4c2f-b353-ec782a46f628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Volume f13d0ef3-0d6a-4121-bb16-c3e5efa249c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f13d0ef3-0d6a-4121-bb16-c3e5efa249c5', 'volume_size': 1} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20807bd-2538-4acb-a925-e57f22b7cd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0407c8b3-7c2a-47f8-96aa-2b41f91488b5', 'volume_name': 'volume-0407c8b3-7c2a-47f8-96aa-2b41f91488b5', 'volume_size': 1, 'source_volid': '88f117bd-573e-467b-a15c-5441a87ca73e', 'source_volstatus': 'available'}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac27809-5cf9-41e5-ba77-3dc330d9e55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac27809-5cf9-41e5-ba77-3dc330d9e55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c976cdc-cf98-4019-9203-c0948ee2644b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:11 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Volume 0407c8b3-7c2a-47f8-96aa-2b41f91488b5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0407c8b3-7c2a-47f8-96aa-2b41f91488b5', 'volume_size': 1, 'source_volid': '88f117bd-573e-467b-a15c-5441a87ca73e', 'source_volstatus': 'available'} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:11 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c6576fd7-9920-469d-aed0-7bbb9d0f0d2c tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-061d110d-0f76-4246-a81a-3a2565f8b276" returned: 0 in 0.747s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c6576fd7-9920-469d-aed0-7bbb9d0f0d2c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-061d110d-0f76-4246-a81a-3a2565f8b276 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:11 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-061d110d-0f76-4246-a81a-3a2565f8b276 Apr 15 20:15:11 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:11 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c" returned: 0 in 0.493s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG cinder.utils [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Path /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-23819005-d2e4-444c-a0ce-ce8329d46ca6 not found in is_blk_device check {{(pid=82989) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 20:15:11 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-23819005-d2e4-444c-a0ce-ce8329d46ca6 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:11 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-23819005-d2e4-444c-a0ce-ce8329d46ca6 Apr 15 20:15:11 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:12 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c6576fd7-9920-469d-aed0-7bbb9d0f0d2c tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-061d110d-0f76-4246-a81a-3a2565f8b276" returned: 0 in 0.419s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:12 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-c6576fd7-9920-469d-aed0-7bbb9d0f0d2c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-quobyte-061d110d-0f76-4246-a81a-3a2565f8b276" released by "delete_volume" :: held 1.193s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:12 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-c6576fd7-9920-469d-aed0-7bbb9d0f0d2c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Created reservations ['8e689b3b-0f91-4c1b-ba90-bb5df0012559', '476112dd-676d-446b-89b8-c15ad6cde561', '8afa1190-cbdf-48c0-9fe0-9d809a52bdbf', '6571fb6c-319c-4cca-b92b-567d49fd4c1b'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c6576fd7-9920-469d-aed0-7bbb9d0f0d2c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c6576fd7-9920-469d-aed0-7bbb9d0f0d2c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:12 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c6576fd7-9920-469d-aed0-7bbb9d0f0d2c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:12 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c6576fd7-9920-469d-aed0-7bbb9d0f0d2c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c6576fd7-9920-469d-aed0-7bbb9d0f0d2c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:12 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c6576fd7-9920-469d-aed0-7bbb9d0f0d2c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:12 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:15:12 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:13 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1e79092f-b981-4c7a-bca2-87fa859aa903 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "cinder-89d0a5d7-e9ac-4feb-a39a-166585f8668f-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:13 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1e79092f-b981-4c7a-bca2-87fa859aa903 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-89d0a5d7-e9ac-4feb-a39a-166585f8668f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:13 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1e79092f-b981-4c7a-bca2-87fa859aa903 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "cinder-quobyte-89d0a5d7-e9ac-4feb-a39a-166585f8668f" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:13 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1e79092f-b981-4c7a-bca2-87fa859aa903 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-quobyte-89d0a5d7-e9ac-4feb-a39a-166585f8668f" acquired by "delete_volume" :: waited 0.037s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:13 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e2d75b-c573-4b7d-ae86-b8b89b8c8e1c]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1e79092f-b981-4c7a-bca2-87fa859aa903 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-89d0a5d7-e9ac-4feb-a39a-166585f8668f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:13 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:13 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c6576fd7-9920-469d-aed0-7bbb9d0f0d2c tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 1.199s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:13 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-c6576fd7-9920-469d-aed0-7bbb9d0f0d2c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:15:13 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-c6576fd7-9920-469d-aed0-7bbb9d0f0d2c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Deleted volume successfully. Apr 15 20:15:13 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-c6576fd7-9920-469d-aed0-7bbb9d0f0d2c tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-061d110d-0f76-4246-a81a-3a2565f8b276-delete_volume" released by "delete_volume" :: held 2.619s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:13 devstack sudo[90832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-89d0a5d7-e9ac-4feb-a39a-166585f8668f Apr 15 20:15:13 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:14 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-23819005-d2e4-444c-a0ce-ce8329d46ca6" returned: 0 in 2.104s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:14 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[11077b26-4acb-4f65-8533-d88ca9a41cbe]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:14 devstack sudo[90834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c Apr 15 20:15:14 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:14 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1e79092f-b981-4c7a-bca2-87fa859aa903 tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-89d0a5d7-e9ac-4feb-a39a-166585f8668f" returned: 0 in 0.781s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1e79092f-b981-4c7a-bca2-87fa859aa903 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-89d0a5d7-e9ac-4feb-a39a-166585f8668f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:14 devstack sudo[90839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-89d0a5d7-e9ac-4feb-a39a-166585f8668f Apr 15 20:15:14 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:14 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c" returned: 0 in 0.591s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:14 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c, size 1024.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-23819005-d2e4-444c-a0ce-ce8329d46ca6 {{(pid=82989) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 20:15:14 devstack cinder-volume[82989]: INFO cinder.image.image_utils [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Converted 1024.00 MB image at 486.58 MB/s Apr 15 20:15:14 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-23819005-d2e4-444c-a0ce-ce8329d46ca6 is being set with open permissions: ugo+rw Apr 15 20:15:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-23819005-d2e4-444c-a0ce-ce8329d46ca6 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:14 devstack sudo[90845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-23819005-d2e4-444c-a0ce-ce8329d46ca6 Apr 15 20:15:14 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:14 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1e79092f-b981-4c7a-bca2-87fa859aa903 tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-89d0a5d7-e9ac-4feb-a39a-166585f8668f" returned: 0 in 0.450s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:14 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1e79092f-b981-4c7a-bca2-87fa859aa903 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-quobyte-89d0a5d7-e9ac-4feb-a39a-166585f8668f" released by "delete_volume" :: held 1.272s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:14 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-1e79092f-b981-4c7a-bca2-87fa859aa903 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Created reservations ['dcba8daa-2d09-4e7a-97c3-088dc49b7070', 'f4ac5478-e242-4337-b693-31969f07e8f3', '01edefe3-f9dc-48e0-81a4-f18d46ee0789', '1e21dfb9-6301-4962-a1a1-6045936d0882'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1e79092f-b981-4c7a-bca2-87fa859aa903 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1e79092f-b981-4c7a-bca2-87fa859aa903 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1e79092f-b981-4c7a-bca2-87fa859aa903 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:14 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1e79092f-b981-4c7a-bca2-87fa859aa903 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1e79092f-b981-4c7a-bca2-87fa859aa903 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:14 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1e79092f-b981-4c7a-bca2-87fa859aa903 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:14 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:15:14 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:15 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-23819005-d2e4-444c-a0ce-ce8329d46ca6" returned: 0 in 0.452s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Lock "cinder-quobyte-23819005-d2e4-444c-a0ce-ce8329d46ca6" released by "_copy_volume_from_snapshot" :: held 4.394s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Lock "cinder-quobyte-f54e7b06-cf38-43a6-b6ed-b3d83abd5841-23819005-d2e4-444c-a0ce-ce8329d46ca6" released by "_create_volume_from_snapshot" :: held 4.421s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.445s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.249s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-999487610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f90c13-964d-4ab8-8e94-529669bcafed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4db362efe7474a82f143ebef950281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:15:11Z,use_quota=True,user_id='edeff680e2f64373a1e295253cc5611c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Creating volume 57f90c13-964d-4ab8-8e94-529669bcafed {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:15:15 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-57f90c13-964d-4ab8-8e94-529669bcafed 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:15 devstack sudo[90851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-57f90c13-964d-4ab8-8e94-529669bcafed 1073741824 Apr 15 20:15:15 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3c4d1d-cbf1-42e4-adb9-581a6167bf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23819005-d2e4-444c-a0ce-ce8329d46ca6', 'volume_size': 1, 'snapshot_id': 'f54e7b06-cf38-43a6-b6ed-b3d83abd5841'}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c816e2d-b2b4-43c8-bf63-915fa839f210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:15 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1e79092f-b981-4c7a-bca2-87fa859aa903 tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.392s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-1e79092f-b981-4c7a-bca2-87fa859aa903 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:15:15 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-1e79092f-b981-4c7a-bca2-87fa859aa903 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Deleted volume successfully. Apr 15 20:15:15 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Volume volume-23819005-d2e4-444c-a0ce-ce8329d46ca6 (23819005-d2e4-444c-a0ce-ce8329d46ca6): created successfully Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c816e2d-b2b4-43c8-bf63-915fa839f210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Flow 'volume_create_manager' (ec825f0b-55b7-4aa4-b9ec-f2ffa5d613db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:15 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-7076fabd-1088-410c-b7ee-9d64d7e42e9f tempest-SnapshotDependencyTests-617452826 None] Created volume successfully. Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1e79092f-b981-4c7a-bca2-87fa859aa903 tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-89d0a5d7-e9ac-4feb-a39a-166585f8668f-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:15 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-57f90c13-964d-4ab8-8e94-529669bcafed 1073741824" returned: 0 in 0.479s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-57f90c13-964d-4ab8-8e94-529669bcafed {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:15 devstack sudo[90858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-57f90c13-964d-4ab8-8e94-529669bcafed Apr 15 20:15:15 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-53f862f4-1c33-4641-ae2f-0f584910cf2a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "cinder-8a5002b5-ba1c-4662-9ea4-2d1b5763f99b-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-53f862f4-1c33-4641-ae2f-0f584910cf2a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-8a5002b5-ba1c-4662-9ea4-2d1b5763f99b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-53f862f4-1c33-4641-ae2f-0f584910cf2a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "cinder-quobyte-5da3f384-d7ab-4740-9475-99ee38739503" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-53f862f4-1c33-4641-ae2f-0f584910cf2a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-quobyte-5da3f384-d7ab-4740-9475-99ee38739503" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-53f862f4-1c33-4641-ae2f-0f584910cf2a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "cinder-quobyte-8a5002b5-ba1c-4662-9ea4-2d1b5763f99b" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-53f862f4-1c33-4641-ae2f-0f584910cf2a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-quobyte-8a5002b5-ba1c-4662-9ea4-2d1b5763f99b" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-53f862f4-1c33-4641-ae2f-0f584910cf2a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Deleting offline snapshot 8a5002b5-ba1c-4662-9ea4-2d1b5763f99b of volume 5da3f384-d7ab-4740-9475-99ee38739503 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-53f862f4-1c33-4641-ae2f-0f584910cf2a tempest-CreateVolumesFromSnapshotTest-1008667287 None] snapshot_file for this snap is: volume-5da3f384-d7ab-4740-9475-99ee38739503.8a5002b5-ba1c-4662-9ea4-2d1b5763f99b {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0754d36-4f26-4429-bc0b-55efd0d2ca41]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:15 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-53f862f4-1c33-4641-ae2f-0f584910cf2a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.8a5002b5-ba1c-4662-9ea4-2d1b5763f99b {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:15 devstack sudo[90860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.8a5002b5-ba1c-4662-9ea4-2d1b5763f99b Apr 15 20:15:15 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:16 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-57f90c13-964d-4ab8-8e94-529669bcafed" returned: 0 in 0.448s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.992s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2073262099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fb711e3-aa1d-4c42-9674-a133a689a445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4db362efe7474a82f143ebef950281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:15:11Z,use_quota=True,user_id='edeff680e2f64373a1e295253cc5611c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Creating volume 0fb711e3-aa1d-4c42-9674-a133a689a445 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:15:16 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fb711e3-aa1d-4c42-9674-a133a689a445 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97117634-42ac-46ff-8370-27000b9f4cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57f90c13-964d-4ab8-8e94-529669bcafed', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:16 devstack sudo[90866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fb711e3-aa1d-4c42-9674-a133a689a445 1073741824 Apr 15 20:15:16 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15ac5530-b774-448f-a709-cdd1a9cdab3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:16 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Volume volume-57f90c13-964d-4ab8-8e94-529669bcafed (57f90c13-964d-4ab8-8e94-529669bcafed): created successfully Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15ac5530-b774-448f-a709-cdd1a9cdab3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Flow 'volume_create_manager' (eafce39b-02e1-40a0-b42f-af6efe5066a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:16 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-78e1090d-2917-44d5-8697-4ea0e9b0d5a6 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Created volume successfully. Apr 15 20:15:16 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-53f862f4-1c33-4641-ae2f-0f584910cf2a tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.8a5002b5-ba1c-4662-9ea4-2d1b5763f99b" returned: 0 in 0.478s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-53f862f4-1c33-4641-ae2f-0f584910cf2a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da3f384-d7ab-4740-9475-99ee38739503(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d06033-ceaf-4639-8332-d0042124af42]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-53f862f4-1c33-4641-ae2f-0f584910cf2a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:16 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503 Apr 15 20:15:16 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8808c64f-fa63-459d-b972-e27739ce45f5 tempest-SnapshotDependencyTests-617452826 None] Acquiring lock "cinder-f54e7b06-cf38-43a6-b6ed-b3d83abd5841-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8808c64f-fa63-459d-b972-e27739ce45f5 tempest-SnapshotDependencyTests-617452826 None] Lock "cinder-f54e7b06-cf38-43a6-b6ed-b3d83abd5841-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8808c64f-fa63-459d-b972-e27739ce45f5 tempest-SnapshotDependencyTests-617452826 None] Acquiring lock "cinder-quobyte-ad95f9b0-54a7-42da-9634-01b5b441c13c" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8808c64f-fa63-459d-b972-e27739ce45f5 tempest-SnapshotDependencyTests-617452826 None] Lock "cinder-quobyte-ad95f9b0-54a7-42da-9634-01b5b441c13c" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8808c64f-fa63-459d-b972-e27739ce45f5 tempest-SnapshotDependencyTests-617452826 None] Acquiring lock "cinder-quobyte-f54e7b06-cf38-43a6-b6ed-b3d83abd5841" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8808c64f-fa63-459d-b972-e27739ce45f5 tempest-SnapshotDependencyTests-617452826 None] Lock "cinder-quobyte-f54e7b06-cf38-43a6-b6ed-b3d83abd5841" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-8808c64f-fa63-459d-b972-e27739ce45f5 tempest-SnapshotDependencyTests-617452826 None] Deleting offline snapshot f54e7b06-cf38-43a6-b6ed-b3d83abd5841 of volume ad95f9b0-54a7-42da-9634-01b5b441c13c {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-8808c64f-fa63-459d-b972-e27739ce45f5 tempest-SnapshotDependencyTests-617452826 None] snapshot_file for this snap is: volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.f54e7b06-cf38-43a6-b6ed-b3d83abd5841 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b37db48-321e-4a3d-afad-ef8d5c348ace]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8808c64f-fa63-459d-b972-e27739ce45f5 tempest-SnapshotDependencyTests-617452826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.f54e7b06-cf38-43a6-b6ed-b3d83abd5841 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:16 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.f54e7b06-cf38-43a6-b6ed-b3d83abd5841 Apr 15 20:15:16 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:16 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fb711e3-aa1d-4c42-9674-a133a689a445 1073741824" returned: 0 in 0.494s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fb711e3-aa1d-4c42-9674-a133a689a445 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:16 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fb711e3-aa1d-4c42-9674-a133a689a445 Apr 15 20:15:16 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:16 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-53f862f4-1c33-4641-ae2f-0f584910cf2a tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503" returned: 0 in 0.522s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-53f862f4-1c33-4641-ae2f-0f584910cf2a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.8a5002b5-ba1c-4662-9ea4-2d1b5763f99b {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:16 devstack sudo[90880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.8a5002b5-ba1c-4662-9ea4-2d1b5763f99b Apr 15 20:15:16 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:16 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8808c64f-fa63-459d-b972-e27739ce45f5 tempest-SnapshotDependencyTests-617452826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.f54e7b06-cf38-43a6-b6ed-b3d83abd5841" returned: 0 in 0.509s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-8808c64f-fa63-459d-b972-e27739ce45f5 tempest-SnapshotDependencyTests-617452826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad95f9b0-54a7-42da-9634-01b5b441c13c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[818315af-604a-475a-bd14-03787953e1ab]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:16 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8808c64f-fa63-459d-b972-e27739ce45f5 tempest-SnapshotDependencyTests-617452826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:16 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c Apr 15 20:15:16 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:17 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fb711e3-aa1d-4c42-9674-a133a689a445" returned: 0 in 0.418s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.641s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1111700818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8acecbe5-fb92-414a-a87f-73eac1af3676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4db362efe7474a82f143ebef950281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:15:11Z,use_quota=True,user_id='edeff680e2f64373a1e295253cc5611c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Creating volume 8acecbe5-fb92-414a-a87f-73eac1af3676 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:15:17 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8acecbe5-fb92-414a-a87f-73eac1af3676 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6f9c28-6ca7-447e-ad09-e946f5bdc540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fb711e3-aa1d-4c42-9674-a133a689a445', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f16e18-7ca3-4da8-949f-478d352a313a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:17 devstack sudo[90888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8acecbe5-fb92-414a-a87f-73eac1af3676 1073741824 Apr 15 20:15:17 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:17 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Volume volume-0fb711e3-aa1d-4c42-9674-a133a689a445 (0fb711e3-aa1d-4c42-9674-a133a689a445): created successfully Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f16e18-7ca3-4da8-949f-478d352a313a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Flow 'volume_create_manager' (fe7c4510-f264-491a-a886-8f987c7d0062) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:17 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-f49a8e60-2c03-4e6c-b0dd-41d730a1325b tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Created volume successfully. Apr 15 20:15:17 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-53f862f4-1c33-4641-ae2f-0f584910cf2a tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.8a5002b5-ba1c-4662-9ea4-2d1b5763f99b" returned: 0 in 0.522s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-53f862f4-1c33-4641-ae2f-0f584910cf2a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.8a5002b5-ba1c-4662-9ea4-2d1b5763f99b {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:17 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.8a5002b5-ba1c-4662-9ea4-2d1b5763f99b Apr 15 20:15:17 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:17 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8808c64f-fa63-459d-b972-e27739ce45f5 tempest-SnapshotDependencyTests-617452826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c" returned: 0 in 0.528s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8808c64f-fa63-459d-b972-e27739ce45f5 tempest-SnapshotDependencyTests-617452826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.f54e7b06-cf38-43a6-b6ed-b3d83abd5841 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:17 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.f54e7b06-cf38-43a6-b6ed-b3d83abd5841 Apr 15 20:15:17 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:17 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8acecbe5-fb92-414a-a87f-73eac1af3676 1073741824" returned: 0 in 0.531s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8acecbe5-fb92-414a-a87f-73eac1af3676 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:17 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8acecbe5-fb92-414a-a87f-73eac1af3676 Apr 15 20:15:17 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:17 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-53f862f4-1c33-4641-ae2f-0f584910cf2a tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503.8a5002b5-ba1c-4662-9ea4-2d1b5763f99b" returned: 0 in 0.416s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-53f862f4-1c33-4641-ae2f-0f584910cf2a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-quobyte-8a5002b5-ba1c-4662-9ea4-2d1b5763f99b" released by "_delete_snapshot" :: held 1.992s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-53f862f4-1c33-4641-ae2f-0f584910cf2a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-quobyte-5da3f384-d7ab-4740-9475-99ee38739503" released by "delete_snapshot" :: held 2.006s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-53f862f4-1c33-4641-ae2f-0f584910cf2a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Created reservations ['2dfef07b-3188-4ee5-8df0-34cb3916dcd6', '06e3401d-94eb-4718-896f-0c516527abfd', 'fb38522f-7c84-44c1-8535-8758c0b8a5f9', '14f4b4d8-10b5-4681-9334-72904509916e'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:17 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-53f862f4-1c33-4641-ae2f-0f584910cf2a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Delete snapshot completed successfully. Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-53f862f4-1c33-4641-ae2f-0f584910cf2a tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-8a5002b5-ba1c-4662-9ea4-2d1b5763f99b-delete_snapshot" released by "delete_snapshot" :: held 2.114s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:17 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8808c64f-fa63-459d-b972-e27739ce45f5 tempest-SnapshotDependencyTests-617452826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.f54e7b06-cf38-43a6-b6ed-b3d83abd5841" returned: 0 in 0.480s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8808c64f-fa63-459d-b972-e27739ce45f5 tempest-SnapshotDependencyTests-617452826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.f54e7b06-cf38-43a6-b6ed-b3d83abd5841 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:17 devstack sudo[90909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.f54e7b06-cf38-43a6-b6ed-b3d83abd5841 Apr 15 20:15:17 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:17 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8acecbe5-fb92-414a-a87f-73eac1af3676" returned: 0 in 0.413s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:15:17 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.301s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2013586018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=157e3e18-ea02-4d75-8b53-5e6258d3f7b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4db362efe7474a82f143ebef950281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:15:12Z,use_quota=True,user_id='edeff680e2f64373a1e295253cc5611c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Creating volume 157e3e18-ea02-4d75-8b53-5e6258d3f7b2 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:15:18 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-157e3e18-ea02-4d75-8b53-5e6258d3f7b2 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d566082-25e9-44c1-98d0-ab41e79981e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8acecbe5-fb92-414a-a87f-73eac1af3676', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:18 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-157e3e18-ea02-4d75-8b53-5e6258d3f7b2 1073741824 Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e0228f-4c28-443a-a0f2-190c83f2a07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:18 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:18 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Volume volume-8acecbe5-fb92-414a-a87f-73eac1af3676 (8acecbe5-fb92-414a-a87f-73eac1af3676): created successfully Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e0228f-4c28-443a-a0f2-190c83f2a07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Flow 'volume_create_manager' (d094209e-e06c-479e-8525-0bf25382cb39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:18 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-444bb1b6-865e-43ec-9882-5a18e78a35ce tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Created volume successfully. Apr 15 20:15:18 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8808c64f-fa63-459d-b972-e27739ce45f5 tempest-SnapshotDependencyTests-617452826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c.f54e7b06-cf38-43a6-b6ed-b3d83abd5841" returned: 0 in 0.402s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8808c64f-fa63-459d-b972-e27739ce45f5 tempest-SnapshotDependencyTests-617452826 None] Lock "cinder-quobyte-f54e7b06-cf38-43a6-b6ed-b3d83abd5841" released by "_delete_snapshot" :: held 1.967s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8808c64f-fa63-459d-b972-e27739ce45f5 tempest-SnapshotDependencyTests-617452826 None] Lock "cinder-quobyte-ad95f9b0-54a7-42da-9634-01b5b441c13c" released by "delete_snapshot" :: held 1.978s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-8808c64f-fa63-459d-b972-e27739ce45f5 tempest-SnapshotDependencyTests-617452826 None] Created reservations ['516856b8-fff9-489a-b237-edb420a92fa4', '6f202bc2-f785-40db-8b66-b3e4aa27a14f', '4a60e365-1929-485c-b9fc-1c8f7385aa50', '6f2aa200-254f-49aa-bcd7-2179a908621b'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:18 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-8808c64f-fa63-459d-b972-e27739ce45f5 tempest-SnapshotDependencyTests-617452826 None] Delete snapshot completed successfully. Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8808c64f-fa63-459d-b972-e27739ce45f5 tempest-SnapshotDependencyTests-617452826 None] Lock "cinder-f54e7b06-cf38-43a6-b6ed-b3d83abd5841-delete_snapshot" released by "delete_snapshot" :: held 2.074s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-c2eee8af-a75a-4ac9-9fe4-dc799295cb8e tempest-SnapshotDependencyTests-617452826 None] Acquiring lock "cinder-ad95f9b0-54a7-42da-9634-01b5b441c13c-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-c2eee8af-a75a-4ac9-9fe4-dc799295cb8e tempest-SnapshotDependencyTests-617452826 None] Lock "cinder-ad95f9b0-54a7-42da-9634-01b5b441c13c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-c2eee8af-a75a-4ac9-9fe4-dc799295cb8e tempest-SnapshotDependencyTests-617452826 None] Acquiring lock "cinder-quobyte-ad95f9b0-54a7-42da-9634-01b5b441c13c" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-c2eee8af-a75a-4ac9-9fe4-dc799295cb8e tempest-SnapshotDependencyTests-617452826 None] Lock "cinder-quobyte-ad95f9b0-54a7-42da-9634-01b5b441c13c" acquired by "delete_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[27336ce4-b788-4ad4-8f48-0c638b8c4d48]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c2eee8af-a75a-4ac9-9fe4-dc799295cb8e tempest-SnapshotDependencyTests-617452826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:18 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-157e3e18-ea02-4d75-8b53-5e6258d3f7b2 1073741824" returned: 0 in 0.518s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-157e3e18-ea02-4d75-8b53-5e6258d3f7b2 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:18 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-157e3e18-ea02-4d75-8b53-5e6258d3f7b2 Apr 15 20:15:18 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:18 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c Apr 15 20:15:18 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dbbc5dfc-dfa7-458e-bf6d-41e2e628263b tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "cinder-5da3f384-d7ab-4740-9475-99ee38739503-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dbbc5dfc-dfa7-458e-bf6d-41e2e628263b tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-5da3f384-d7ab-4740-9475-99ee38739503-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dbbc5dfc-dfa7-458e-bf6d-41e2e628263b tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "cinder-quobyte-5da3f384-d7ab-4740-9475-99ee38739503" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dbbc5dfc-dfa7-458e-bf6d-41e2e628263b tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-quobyte-5da3f384-d7ab-4740-9475-99ee38739503" acquired by "delete_volume" :: waited 0.006s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c2ec87-4bdf-4664-9b24-b9a5fe21db81]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dbbc5dfc-dfa7-458e-bf6d-41e2e628263b tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:18 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503 Apr 15 20:15:18 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:18 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-157e3e18-ea02-4d75-8b53-5e6258d3f7b2" returned: 0 in 0.421s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.175s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-667325992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13d0ef3-0d6a-4121-bb16-c3e5efa249c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4db362efe7474a82f143ebef950281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:15:12Z,use_quota=True,user_id='edeff680e2f64373a1e295253cc5611c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Creating volume f13d0ef3-0d6a-4121-bb16-c3e5efa249c5 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:15:18 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f13d0ef3-0d6a-4121-bb16-c3e5efa249c5 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:18 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed2b0e9-fd13-4471-a5c6-153eabc3fba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-157e3e18-ea02-4d75-8b53-5e6258d3f7b2', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:19 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f13d0ef3-0d6a-4121-bb16-c3e5efa249c5 1073741824 Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68e2dad-1473-4112-b971-aadc8afdc3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:19 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:19 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Volume volume-157e3e18-ea02-4d75-8b53-5e6258d3f7b2 (157e3e18-ea02-4d75-8b53-5e6258d3f7b2): created successfully Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68e2dad-1473-4112-b971-aadc8afdc3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Flow 'volume_create_manager' (fab4c1b2-9631-4e7b-955e-212d43c5aec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:19 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c2eee8af-a75a-4ac9-9fe4-dc799295cb8e tempest-SnapshotDependencyTests-617452826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c" returned: 0 in 0.508s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c2eee8af-a75a-4ac9-9fe4-dc799295cb8e tempest-SnapshotDependencyTests-617452826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:19 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-1e3567f6-9880-4eed-b4f8-c6eb1d8c8b5a tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Created volume successfully. Apr 15 20:15:19 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c Apr 15 20:15:19 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:19 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dbbc5dfc-dfa7-458e-bf6d-41e2e628263b tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503" returned: 0 in 0.489s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dbbc5dfc-dfa7-458e-bf6d-41e2e628263b tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:19 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503 Apr 15 20:15:19 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:19 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f13d0ef3-0d6a-4121-bb16-c3e5efa249c5 1073741824" returned: 0 in 0.507s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:19 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c2eee8af-a75a-4ac9-9fe4-dc799295cb8e tempest-SnapshotDependencyTests-617452826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-ad95f9b0-54a7-42da-9634-01b5b441c13c" returned: 0 in 0.474s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-c2eee8af-a75a-4ac9-9fe4-dc799295cb8e tempest-SnapshotDependencyTests-617452826 None] Lock "cinder-quobyte-ad95f9b0-54a7-42da-9634-01b5b441c13c" released by "delete_volume" :: held 1.014s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f13d0ef3-0d6a-4121-bb16-c3e5efa249c5 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:19 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f13d0ef3-0d6a-4121-bb16-c3e5efa249c5 Apr 15 20:15:19 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-c2eee8af-a75a-4ac9-9fe4-dc799295cb8e tempest-SnapshotDependencyTests-617452826 None] Created reservations ['cc328469-27d4-42cb-a53b-fe0124364e5e', 'ce18a952-3f5a-4bf3-862a-490f430105d0', 'd0cb1f1b-5335-48ca-b317-5e8771851994', 'ebe80383-0335-49a4-a6a0-2c82f6921148'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c2eee8af-a75a-4ac9-9fe4-dc799295cb8e tempest-SnapshotDependencyTests-617452826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c2eee8af-a75a-4ac9-9fe4-dc799295cb8e tempest-SnapshotDependencyTests-617452826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c2eee8af-a75a-4ac9-9fe4-dc799295cb8e tempest-SnapshotDependencyTests-617452826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-c2eee8af-a75a-4ac9-9fe4-dc799295cb8e tempest-SnapshotDependencyTests-617452826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-c2eee8af-a75a-4ac9-9fe4-dc799295cb8e tempest-SnapshotDependencyTests-617452826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c2eee8af-a75a-4ac9-9fe4-dc799295cb8e tempest-SnapshotDependencyTests-617452826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:19 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:15:19 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:19 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dbbc5dfc-dfa7-458e-bf6d-41e2e628263b tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5da3f384-d7ab-4740-9475-99ee38739503" returned: 0 in 0.421s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dbbc5dfc-dfa7-458e-bf6d-41e2e628263b tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-quobyte-5da3f384-d7ab-4740-9475-99ee38739503" released by "delete_volume" :: held 0.937s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-dbbc5dfc-dfa7-458e-bf6d-41e2e628263b tempest-CreateVolumesFromSnapshotTest-1008667287 None] Created reservations ['9af1d237-22ab-4f24-bf3e-028c0e5b816d', '51a425b0-1a98-46f2-9eed-201ca28f24e7', '0bdf7a66-4783-4321-a9a0-d47e3e3aa50b', '6e3141e2-959c-4f14-9942-5d8358e191c0'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dbbc5dfc-dfa7-458e-bf6d-41e2e628263b tempest-CreateVolumesFromSnapshotTest-1008667287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dbbc5dfc-dfa7-458e-bf6d-41e2e628263b tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-dbbc5dfc-dfa7-458e-bf6d-41e2e628263b tempest-CreateVolumesFromSnapshotTest-1008667287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-dbbc5dfc-dfa7-458e-bf6d-41e2e628263b tempest-CreateVolumesFromSnapshotTest-1008667287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dbbc5dfc-dfa7-458e-bf6d-41e2e628263b tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dbbc5dfc-dfa7-458e-bf6d-41e2e628263b tempest-CreateVolumesFromSnapshotTest-1008667287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:19 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:15:19 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:19 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f13d0ef3-0d6a-4121-bb16-c3e5efa249c5" returned: 0 in 0.437s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.148s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:19 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Cloning volume 88f117bd-573e-467b-a15c-5441a87ca73e to volume 0407c8b3-7c2a-47f8-96aa-2b41f91488b5 Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6e6127-7e74-4c2f-b353-ec782a46f628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f13d0ef3-0d6a-4121-bb16-c3e5efa249c5', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:19 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (166a329d-016f-4fe6-835d-52eb38e61f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:20 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Volume volume-f13d0ef3-0d6a-4121-bb16-c3e5efa249c5 (f13d0ef3-0d6a-4121-bb16-c3e5efa249c5): created successfully Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (166a329d-016f-4fe6-835d-52eb38e61f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Flow 'volume_create_manager' (4d9a3bc1-a57f-4b5a-9a9b-2784ca482255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Creating offline snapshot 456867f1-a55e-4d6a-9097-52deb66da0da of volume 88f117bd-573e-467b-a15c-5441a87ca73e {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:15:20 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-3dc25716-25e0-49f9-8996-e9f3755598a5 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Created volume successfully. Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[1110dbd6-8274-40be-8a54-ccef5cd412b9]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:20 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-c2eee8af-a75a-4ac9-9fe4-dc799295cb8e tempest-SnapshotDependencyTests-617452826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.472s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-c2eee8af-a75a-4ac9-9fe4-dc799295cb8e tempest-SnapshotDependencyTests-617452826 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:15:20 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-c2eee8af-a75a-4ac9-9fe4-dc799295cb8e tempest-SnapshotDependencyTests-617452826 None] Deleted volume successfully. Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-c2eee8af-a75a-4ac9-9fe4-dc799295cb8e tempest-SnapshotDependencyTests-617452826 None] Lock "cinder-ad95f9b0-54a7-42da-9634-01b5b441c13c-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:20 devstack sudo[90950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e Apr 15 20:15:20 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:20 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dbbc5dfc-dfa7-458e-bf6d-41e2e628263b tempest-CreateVolumesFromSnapshotTest-1008667287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.507s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-dbbc5dfc-dfa7-458e-bf6d-41e2e628263b tempest-CreateVolumesFromSnapshotTest-1008667287 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:15:20 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-dbbc5dfc-dfa7-458e-bf6d-41e2e628263b tempest-CreateVolumesFromSnapshotTest-1008667287 None] Deleted volume successfully. Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dbbc5dfc-dfa7-458e-bf6d-41e2e628263b tempest-CreateVolumesFromSnapshotTest-1008667287 None] Lock "cinder-5da3f384-d7ab-4740-9475-99ee38739503-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8edbb30a-bbd3-4c24-b3cc-e9db5eb92b2e tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "cinder-f13d0ef3-0d6a-4121-bb16-c3e5efa249c5-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8edbb30a-bbd3-4c24-b3cc-e9db5eb92b2e tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-f13d0ef3-0d6a-4121-bb16-c3e5efa249c5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8edbb30a-bbd3-4c24-b3cc-e9db5eb92b2e tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "cinder-quobyte-f13d0ef3-0d6a-4121-bb16-c3e5efa249c5" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8edbb30a-bbd3-4c24-b3cc-e9db5eb92b2e tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-quobyte-f13d0ef3-0d6a-4121-bb16-c3e5efa249c5" acquired by "delete_volume" :: waited 0.012s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[a235cfcf-3c82-4a90-b056-aeadd4fbb721]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8edbb30a-bbd3-4c24-b3cc-e9db5eb92b2e tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f13d0ef3-0d6a-4121-bb16-c3e5efa249c5 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-588d77a3-c733-4e57-8fad-d4a1a1eed7f2 tempest-SnapshotDependencyTests-617452826 None] Acquiring lock "cinder-23819005-d2e4-444c-a0ce-ce8329d46ca6-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:20 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e" returned: 0 in 0.603s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.456867f1-a55e-4d6a-9097-52deb66da0da 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-588d77a3-c733-4e57-8fad-d4a1a1eed7f2 tempest-SnapshotDependencyTests-617452826 None] Lock "cinder-23819005-d2e4-444c-a0ce-ce8329d46ca6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:20 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.456867f1-a55e-4d6a-9097-52deb66da0da 1G Apr 15 20:15:20 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:20 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f13d0ef3-0d6a-4121-bb16-c3e5efa249c5 Apr 15 20:15:20 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-588d77a3-c733-4e57-8fad-d4a1a1eed7f2 tempest-SnapshotDependencyTests-617452826 None] Acquiring lock "cinder-quobyte-23819005-d2e4-444c-a0ce-ce8329d46ca6" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-588d77a3-c733-4e57-8fad-d4a1a1eed7f2 tempest-SnapshotDependencyTests-617452826 None] Lock "cinder-quobyte-23819005-d2e4-444c-a0ce-ce8329d46ca6" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8436f1-c5ff-4d48-9584-66968cacef97]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:20 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-588d77a3-c733-4e57-8fad-d4a1a1eed7f2 tempest-SnapshotDependencyTests-617452826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-23819005-d2e4-444c-a0ce-ce8329d46ca6 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:20 devstack sudo[90961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-23819005-d2e4-444c-a0ce-ce8329d46ca6 Apr 15 20:15:20 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:21 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8edbb30a-bbd3-4c24-b3cc-e9db5eb92b2e tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f13d0ef3-0d6a-4121-bb16-c3e5efa249c5" returned: 0 in 0.620s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8edbb30a-bbd3-4c24-b3cc-e9db5eb92b2e tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f13d0ef3-0d6a-4121-bb16-c3e5efa249c5 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:21 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.456867f1-a55e-4d6a-9097-52deb66da0da 1G" returned: 0 in 0.563s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88f117bd-573e-467b-a15c-5441a87ca73e -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.456867f1-a55e-4d6a-9097-52deb66da0da {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:21 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f13d0ef3-0d6a-4121-bb16-c3e5efa249c5 Apr 15 20:15:21 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:21 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88f117bd-573e-467b-a15c-5441a87ca73e -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.456867f1-a55e-4d6a-9097-52deb66da0da Apr 15 20:15:21 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:21 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-588d77a3-c733-4e57-8fad-d4a1a1eed7f2 tempest-SnapshotDependencyTests-617452826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-23819005-d2e4-444c-a0ce-ce8329d46ca6" returned: 0 in 0.626s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-588d77a3-c733-4e57-8fad-d4a1a1eed7f2 tempest-SnapshotDependencyTests-617452826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-23819005-d2e4-444c-a0ce-ce8329d46ca6 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:21 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-23819005-d2e4-444c-a0ce-ce8329d46ca6 Apr 15 20:15:21 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:21 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88f117bd-573e-467b-a15c-5441a87ca73e -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.456867f1-a55e-4d6a-9097-52deb66da0da" returned: 0 in 0.465s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:21 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.456867f1-a55e-4d6a-9097-52deb66da0da is being set with open permissions: ugo+rw Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.456867f1-a55e-4d6a-9097-52deb66da0da {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:21 devstack sudo[90982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.456867f1-a55e-4d6a-9097-52deb66da0da Apr 15 20:15:21 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:21 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8edbb30a-bbd3-4c24-b3cc-e9db5eb92b2e tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-f13d0ef3-0d6a-4121-bb16-c3e5efa249c5" returned: 0 in 0.537s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8edbb30a-bbd3-4c24-b3cc-e9db5eb92b2e tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-quobyte-f13d0ef3-0d6a-4121-bb16-c3e5efa249c5" released by "delete_volume" :: held 1.203s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG dbcounter [-] [82989] Writing DB stats cinder:UPDATE=256,cinder:SELECT=163,cinder:INSERT=52,cinder:DELETE=20 {{(pid=82989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-8edbb30a-bbd3-4c24-b3cc-e9db5eb92b2e tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Created reservations ['72c0c4af-f36c-4e18-aec1-0e4990153255', '70cd5dda-9b9d-432c-af49-d1286f791f9f', 'ca7b40f7-468b-476d-ae39-300cb2fd19de', 'eb8acc94-e8ad-4a83-b787-532374672b31'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8edbb30a-bbd3-4c24-b3cc-e9db5eb92b2e tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8edbb30a-bbd3-4c24-b3cc-e9db5eb92b2e tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-8edbb30a-bbd3-4c24-b3cc-e9db5eb92b2e tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-8edbb30a-bbd3-4c24-b3cc-e9db5eb92b2e tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-8edbb30a-bbd3-4c24-b3cc-e9db5eb92b2e tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8edbb30a-bbd3-4c24-b3cc-e9db5eb92b2e tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:21 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:15:21 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:15:21 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Flow 'volume_create_manager' (ee93fc99-ccb4-4ee9-b571-565c9183a34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3b1f31-2ae7-4735-a4c2-7112de65ddba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-588d77a3-c733-4e57-8fad-d4a1a1eed7f2 tempest-SnapshotDependencyTests-617452826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-23819005-d2e4-444c-a0ce-ce8329d46ca6" returned: 0 in 0.604s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3b1f31-2ae7-4735-a4c2-7112de65ddba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dfd0006-82cd-446d-a226-115a2c7b43dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94404f2908ba48bcbde3d9af4557b3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:15:22Z,use_quota=True,user_id='b3f39a3ca4164877812a64ccffc7977b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (265117f8-352d-4fc0-b8de-9795f2ef64b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (265117f8-352d-4fc0-b8de-9795f2ef64b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e9a326-83be-4a50-baa4-bcabfc0c9f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e9a326-83be-4a50-baa4-bcabfc0c9f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dfd0006-82cd-446d-a226-115a2c7b43dd', 'volume_name': 'volume-4dfd0006-82cd-446d-a226-115a2c7b43dd', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30737d51-8179-40a8-aa6e-614734428d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30737d51-8179-40a8-aa6e-614734428d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa45eeb-bc86-4eac-b891-e758d24cc627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:21 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Volume 4dfd0006-82cd-446d-a226-115a2c7b43dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dfd0006-82cd-446d-a226-115a2c7b43dd', 'volume_size': 1} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:21 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-588d77a3-c733-4e57-8fad-d4a1a1eed7f2 tempest-SnapshotDependencyTests-617452826 None] Lock "cinder-quobyte-23819005-d2e4-444c-a0ce-ce8329d46ca6" released by "delete_volume" :: held 1.289s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:22 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-588d77a3-c733-4e57-8fad-d4a1a1eed7f2 tempest-SnapshotDependencyTests-617452826 None] Created reservations ['364aaafb-6693-4a7c-99a3-c61c969da12f', 'b6bf020f-6430-45cd-a322-491e45349660', '01a8f237-3a35-4479-8ef6-42d6d6f1de8d', '0f2a9a56-9200-46df-8ce5-3d16a89f51c0'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-588d77a3-c733-4e57-8fad-d4a1a1eed7f2 tempest-SnapshotDependencyTests-617452826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-588d77a3-c733-4e57-8fad-d4a1a1eed7f2 tempest-SnapshotDependencyTests-617452826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:22 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-588d77a3-c733-4e57-8fad-d4a1a1eed7f2 tempest-SnapshotDependencyTests-617452826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:22 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-588d77a3-c733-4e57-8fad-d4a1a1eed7f2 tempest-SnapshotDependencyTests-617452826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-588d77a3-c733-4e57-8fad-d4a1a1eed7f2 tempest-SnapshotDependencyTests-617452826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-588d77a3-c733-4e57-8fad-d4a1a1eed7f2 tempest-SnapshotDependencyTests-617452826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:22 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:15:22 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:22 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.456867f1-a55e-4d6a-9097-52deb66da0da" returned: 0 in 0.532s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:22 devstack sudo[90992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.info Apr 15 20:15:22 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:22 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-8edbb30a-bbd3-4c24-b3cc-e9db5eb92b2e tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.449s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:22 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-8edbb30a-bbd3-4c24-b3cc-e9db5eb92b2e tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:15:22 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-8edbb30a-bbd3-4c24-b3cc-e9db5eb92b2e tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Deleted volume successfully. Apr 15 20:15:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-8edbb30a-bbd3-4c24-b3cc-e9db5eb92b2e tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-f13d0ef3-0d6a-4121-bb16-c3e5efa249c5-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:22 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-588d77a3-c733-4e57-8fad-d4a1a1eed7f2 tempest-SnapshotDependencyTests-617452826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.428s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:22 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-588d77a3-c733-4e57-8fad-d4a1a1eed7f2 tempest-SnapshotDependencyTests-617452826 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:15:22 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-588d77a3-c733-4e57-8fad-d4a1a1eed7f2 tempest-SnapshotDependencyTests-617452826 None] Deleted volume successfully. Apr 15 20:15:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-588d77a3-c733-4e57-8fad-d4a1a1eed7f2 tempest-SnapshotDependencyTests-617452826 None] Lock "cinder-23819005-d2e4-444c-a0ce-ce8329d46ca6-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:22 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.info" returned: 0 in 0.417s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:22 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.info is being set with open permissions: ugo+rw Apr 15 20:15:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:22 devstack sudo[90996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.info Apr 15 20:15:22 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7c8d0c82-20a9-4e35-9981-e86c8acb2ebc tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "cinder-157e3e18-ea02-4d75-8b53-5e6258d3f7b2-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7c8d0c82-20a9-4e35-9981-e86c8acb2ebc tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-157e3e18-ea02-4d75-8b53-5e6258d3f7b2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7c8d0c82-20a9-4e35-9981-e86c8acb2ebc tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "cinder-quobyte-157e3e18-ea02-4d75-8b53-5e6258d3f7b2" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:22 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7c8d0c82-20a9-4e35-9981-e86c8acb2ebc tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-quobyte-157e3e18-ea02-4d75-8b53-5e6258d3f7b2" acquired by "delete_volume" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:22 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62f7f4d-866a-4cae-b261-2f45bcd06642]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:22 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7c8d0c82-20a9-4e35-9981-e86c8acb2ebc tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-157e3e18-ea02-4d75-8b53-5e6258d3f7b2 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:22 devstack sudo[90998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-157e3e18-ea02-4d75-8b53-5e6258d3f7b2 Apr 15 20:15:22 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:23 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.info" returned: 0 in 0.469s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Acquiring lock "cinder-quobyte-0407c8b3-7c2a-47f8-96aa-2b41f91488b5" by "_copy_volume_from_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Lock "cinder-quobyte-0407c8b3-7c2a-47f8-96aa-2b41f91488b5" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] snapshot: 456867f1-a55e-4d6a-9097-52deb66da0da, volume: 0407c8b3-7c2a-47f8-96aa-2b41f91488b5, {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[a826be91-2c9e-4f45-a03d-27e4da1a0fa7]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.456867f1-a55e-4d6a-9097-52deb66da0da {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:23 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.456867f1-a55e-4d6a-9097-52deb66da0da Apr 15 20:15:23 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:23 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7c8d0c82-20a9-4e35-9981-e86c8acb2ebc tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-157e3e18-ea02-4d75-8b53-5e6258d3f7b2" returned: 0 in 0.572s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7c8d0c82-20a9-4e35-9981-e86c8acb2ebc tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-157e3e18-ea02-4d75-8b53-5e6258d3f7b2 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:23 devstack sudo[91006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-157e3e18-ea02-4d75-8b53-5e6258d3f7b2 Apr 15 20:15:23 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:23 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.456867f1-a55e-4d6a-9097-52deb66da0da" returned: 0 in 0.574s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88f117bd-573e-467b-a15c-5441a87ca73e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Creating direct copy from snapshot {{(pid=82989) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[045221c2-f55f-40b9-a728-e7169289429a]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:23 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e Apr 15 20:15:23 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:23 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7c8d0c82-20a9-4e35-9981-e86c8acb2ebc tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-157e3e18-ea02-4d75-8b53-5e6258d3f7b2" returned: 0 in 0.492s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7c8d0c82-20a9-4e35-9981-e86c8acb2ebc tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-quobyte-157e3e18-ea02-4d75-8b53-5e6258d3f7b2" released by "delete_volume" :: held 1.088s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-7c8d0c82-20a9-4e35-9981-e86c8acb2ebc tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Created reservations ['2e4038fe-b419-40ab-bdb6-44bda915042d', 'e8bb017f-5c11-44e6-b5ec-6306f2f5864a', '7c91d94d-6527-436e-8ee7-15b61cbacd2a', '647749a2-5507-4b86-9318-33191b120eff'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7c8d0c82-20a9-4e35-9981-e86c8acb2ebc tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7c8d0c82-20a9-4e35-9981-e86c8acb2ebc tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7c8d0c82-20a9-4e35-9981-e86c8acb2ebc tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-7c8d0c82-20a9-4e35-9981-e86c8acb2ebc tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-7c8d0c82-20a9-4e35-9981-e86c8acb2ebc tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:23 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7c8d0c82-20a9-4e35-9981-e86c8acb2ebc tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:23 devstack sudo[91015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:15:23 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:24 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e" returned: 0 in 0.527s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:24 devstack cinder-volume[82989]: DEBUG cinder.utils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Path /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0407c8b3-7c2a-47f8-96aa-2b41f91488b5 not found in is_blk_device check {{(pid=82989) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 20:15:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0407c8b3-7c2a-47f8-96aa-2b41f91488b5 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:24 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0407c8b3-7c2a-47f8-96aa-2b41f91488b5 Apr 15 20:15:24 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:24 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:24 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-7c8d0c82-20a9-4e35-9981-e86c8acb2ebc tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.434s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:24 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-7c8d0c82-20a9-4e35-9981-e86c8acb2ebc tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:15:24 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-7c8d0c82-20a9-4e35-9981-e86c8acb2ebc tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Deleted volume successfully. Apr 15 20:15:24 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-7c8d0c82-20a9-4e35-9981-e86c8acb2ebc tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-157e3e18-ea02-4d75-8b53-5e6258d3f7b2-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-22a343b9-a191-4787-b090-79062d637bc8 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "cinder-8acecbe5-fb92-414a-a87f-73eac1af3676-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-22a343b9-a191-4787-b090-79062d637bc8 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-8acecbe5-fb92-414a-a87f-73eac1af3676-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-22a343b9-a191-4787-b090-79062d637bc8 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "cinder-quobyte-8acecbe5-fb92-414a-a87f-73eac1af3676" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:25 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-22a343b9-a191-4787-b090-79062d637bc8 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-quobyte-8acecbe5-fb92-414a-a87f-73eac1af3676" acquired by "delete_volume" :: waited 0.014s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:25 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa221a8-53bc-4059-bf23-467a6de136fc]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:25 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-22a343b9-a191-4787-b090-79062d637bc8 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8acecbe5-fb92-414a-a87f-73eac1af3676 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:25 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8acecbe5-fb92-414a-a87f-73eac1af3676 Apr 15 20:15:25 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:26 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-22a343b9-a191-4787-b090-79062d637bc8 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8acecbe5-fb92-414a-a87f-73eac1af3676" returned: 0 in 1.402s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-22a343b9-a191-4787-b090-79062d637bc8 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8acecbe5-fb92-414a-a87f-73eac1af3676 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:26 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8acecbe5-fb92-414a-a87f-73eac1af3676 Apr 15 20:15:26 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:26 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0407c8b3-7c2a-47f8-96aa-2b41f91488b5" returned: 0 in 2.377s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:26 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[5732a522-2439-4c7f-8f10-62f984de8ad2]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:26 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:26 devstack sudo[91041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e Apr 15 20:15:26 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:27 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-22a343b9-a191-4787-b090-79062d637bc8 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-8acecbe5-fb92-414a-a87f-73eac1af3676" returned: 0 in 0.466s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-22a343b9-a191-4787-b090-79062d637bc8 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-quobyte-8acecbe5-fb92-414a-a87f-73eac1af3676" released by "delete_volume" :: held 1.917s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-22a343b9-a191-4787-b090-79062d637bc8 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Created reservations ['763527db-3045-4024-944f-d30c4c112a57', '2beff624-7ed1-480b-9048-7c30bc0e7013', 'ec9fa8eb-e2bf-45ec-bb27-3698f86363e3', 'abff91ab-65a8-4fe9-a21c-5155b3ecda1e'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-22a343b9-a191-4787-b090-79062d637bc8 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-22a343b9-a191-4787-b090-79062d637bc8 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-22a343b9-a191-4787-b090-79062d637bc8 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-22a343b9-a191-4787-b090-79062d637bc8 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-22a343b9-a191-4787-b090-79062d637bc8 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-22a343b9-a191-4787-b090-79062d637bc8 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:27 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:15:27 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:27 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e" returned: 0 in 0.609s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG cinder.image.image_utils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e, size 1024.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0407c8b3-7c2a-47f8-96aa-2b41f91488b5 {{(pid=82989) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 20:15:27 devstack cinder-volume[82989]: INFO cinder.image.image_utils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Converted 1024.00 MB image at 430.62 MB/s Apr 15 20:15:27 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0407c8b3-7c2a-47f8-96aa-2b41f91488b5 is being set with open permissions: ugo+rw Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0407c8b3-7c2a-47f8-96aa-2b41f91488b5 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:27 devstack sudo[91049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0407c8b3-7c2a-47f8-96aa-2b41f91488b5 Apr 15 20:15:27 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dfac190a-21be-423c-9cef-a07d39a40f8c tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "cinder-0fb711e3-aa1d-4c42-9674-a133a689a445-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dfac190a-21be-423c-9cef-a07d39a40f8c tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-0fb711e3-aa1d-4c42-9674-a133a689a445-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dfac190a-21be-423c-9cef-a07d39a40f8c tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "cinder-quobyte-0fb711e3-aa1d-4c42-9674-a133a689a445" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dfac190a-21be-423c-9cef-a07d39a40f8c tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-quobyte-0fb711e3-aa1d-4c42-9674-a133a689a445" acquired by "delete_volume" :: waited 0.014s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9ea834-8842-49f5-819c-6e9c3045bd27]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dfac190a-21be-423c-9cef-a07d39a40f8c tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fb711e3-aa1d-4c42-9674-a133a689a445 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:27 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-22a343b9-a191-4787-b090-79062d637bc8 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.461s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-22a343b9-a191-4787-b090-79062d637bc8 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:15:27 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-22a343b9-a191-4787-b090-79062d637bc8 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Deleted volume successfully. Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-22a343b9-a191-4787-b090-79062d637bc8 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-8acecbe5-fb92-414a-a87f-73eac1af3676-delete_volume" released by "delete_volume" :: held 2.592s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:27 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fb711e3-aa1d-4c42-9674-a133a689a445 Apr 15 20:15:27 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG oslo_service.periodic_task [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82989) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:27 devstack sudo[91055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:15:27 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:27 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0407c8b3-7c2a-47f8-96aa-2b41f91488b5" returned: 0 in 0.555s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Lock "cinder-quobyte-0407c8b3-7c2a-47f8-96aa-2b41f91488b5" released by "_copy_volume_from_snapshot" :: held 4.697s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Acquiring lock "cinder-quobyte-456867f1-a55e-4d6a-9097-52deb66da0da" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Lock "cinder-quobyte-456867f1-a55e-4d6a-9097-52deb66da0da" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Deleting offline snapshot 456867f1-a55e-4d6a-9097-52deb66da0da of volume 88f117bd-573e-467b-a15c-5441a87ca73e {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] snapshot_file for this snap is: volume-88f117bd-573e-467b-a15c-5441a87ca73e.456867f1-a55e-4d6a-9097-52deb66da0da {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e5f99e-417b-41da-988c-e51874199c93]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:27 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.456867f1-a55e-4d6a-9097-52deb66da0da {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:27 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.456867f1-a55e-4d6a-9097-52deb66da0da Apr 15 20:15:27 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:28 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dfac190a-21be-423c-9cef-a07d39a40f8c tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fb711e3-aa1d-4c42-9674-a133a689a445" returned: 0 in 0.532s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dfac190a-21be-423c-9cef-a07d39a40f8c tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fb711e3-aa1d-4c42-9674-a133a689a445 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:28 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fb711e3-aa1d-4c42-9674-a133a689a445 Apr 15 20:15:28 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:28 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.477s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:28 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-376fbd0e-c3b6-4bcd-b879-3e3c9be3d43f None None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:15:28 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.456867f1-a55e-4d6a-9097-52deb66da0da" returned: 0 in 0.546s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:28 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88f117bd-573e-467b-a15c-5441a87ca73e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:15:28 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eea6681-7827-4ece-a399-ab53d8c32bad]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:28 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e Apr 15 20:15:28 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:28 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dfac190a-21be-423c-9cef-a07d39a40f8c tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fb711e3-aa1d-4c42-9674-a133a689a445" returned: 0 in 0.493s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:28 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dfac190a-21be-423c-9cef-a07d39a40f8c tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-quobyte-0fb711e3-aa1d-4c42-9674-a133a689a445" released by "delete_volume" :: held 1.055s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:28 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-dfac190a-21be-423c-9cef-a07d39a40f8c tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Created reservations ['8a8543af-930e-42f6-be59-def0ffee9651', '0b9b90c4-7a78-41e9-9713-077734c57197', 'dc56f8fc-6e62-4896-9dae-2b472433c44b', '8f096dce-5b5a-4673-91cd-1571c1d47401'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dfac190a-21be-423c-9cef-a07d39a40f8c tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dfac190a-21be-423c-9cef-a07d39a40f8c tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:28 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-dfac190a-21be-423c-9cef-a07d39a40f8c tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:28 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-dfac190a-21be-423c-9cef-a07d39a40f8c tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dfac190a-21be-423c-9cef-a07d39a40f8c tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dfac190a-21be-423c-9cef-a07d39a40f8c tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:28 devstack sudo[91072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:15:28 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:28 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e" returned: 0 in 0.547s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:28 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.456867f1-a55e-4d6a-9097-52deb66da0da {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:29 devstack sudo[91077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.456867f1-a55e-4d6a-9097-52deb66da0da Apr 15 20:15:29 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:29 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dfac190a-21be-423c-9cef-a07d39a40f8c tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.467s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:29 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-dfac190a-21be-423c-9cef-a07d39a40f8c tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:15:29 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-dfac190a-21be-423c-9cef-a07d39a40f8c tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Deleted volume successfully. Apr 15 20:15:29 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dfac190a-21be-423c-9cef-a07d39a40f8c tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-0fb711e3-aa1d-4c42-9674-a133a689a445-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:29 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.456867f1-a55e-4d6a-9097-52deb66da0da" returned: 0 in 0.538s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.456867f1-a55e-4d6a-9097-52deb66da0da {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:29 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a9a580e5-28cf-4194-917f-c5d485af2b39 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "cinder-57f90c13-964d-4ab8-8e94-529669bcafed-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:29 devstack sudo[91084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.456867f1-a55e-4d6a-9097-52deb66da0da Apr 15 20:15:29 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:29 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a9a580e5-28cf-4194-917f-c5d485af2b39 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-57f90c13-964d-4ab8-8e94-529669bcafed-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:29 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a9a580e5-28cf-4194-917f-c5d485af2b39 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "cinder-quobyte-57f90c13-964d-4ab8-8e94-529669bcafed" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:29 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a9a580e5-28cf-4194-917f-c5d485af2b39 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-quobyte-57f90c13-964d-4ab8-8e94-529669bcafed" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:29 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5ba975-1cfe-4218-ac24-b81807f650cc]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:29 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a9a580e5-28cf-4194-917f-c5d485af2b39 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-57f90c13-964d-4ab8-8e94-529669bcafed {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:29 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-57f90c13-964d-4ab8-8e94-529669bcafed Apr 15 20:15:29 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:30 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e.456867f1-a55e-4d6a-9097-52deb66da0da" returned: 0 in 0.522s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Lock "cinder-quobyte-456867f1-a55e-4d6a-9097-52deb66da0da" released by "_delete_snapshot" :: held 2.214s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.114s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.106s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dfd0006-82cd-446d-a226-115a2c7b43dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94404f2908ba48bcbde3d9af4557b3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:15:22Z,use_quota=True,user_id='b3f39a3ca4164877812a64ccffc7977b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Creating volume 4dfd0006-82cd-446d-a226-115a2c7b43dd {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:15:30 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4dfd0006-82cd-446d-a226-115a2c7b43dd 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c976cdc-cf98-4019-9203-c0948ee2644b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0407c8b3-7c2a-47f8-96aa-2b41f91488b5', 'volume_size': 1, 'source_volid': '88f117bd-573e-467b-a15c-5441a87ca73e', 'source_volstatus': 'available'}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ee8d49-915b-4828-bf11-760826f08069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:30 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4dfd0006-82cd-446d-a226-115a2c7b43dd 1073741824 Apr 15 20:15:30 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:30 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a9a580e5-28cf-4194-917f-c5d485af2b39 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-57f90c13-964d-4ab8-8e94-529669bcafed" returned: 0 in 0.544s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a9a580e5-28cf-4194-917f-c5d485af2b39 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-57f90c13-964d-4ab8-8e94-529669bcafed {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:30 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Volume volume-0407c8b3-7c2a-47f8-96aa-2b41f91488b5 (0407c8b3-7c2a-47f8-96aa-2b41f91488b5): created successfully Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ee8d49-915b-4828-bf11-760826f08069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Flow 'volume_create_manager' (16664e99-9df8-4cf2-afb8-4e18500f7257) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:30 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-1b56b384-90e8-4813-8d02-5b80116cf190 tempest-VolumeDependencyTests-116051424 None] Created volume successfully. Apr 15 20:15:30 devstack sudo[91094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-57f90c13-964d-4ab8-8e94-529669bcafed Apr 15 20:15:30 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:30 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4dfd0006-82cd-446d-a226-115a2c7b43dd 1073741824" returned: 0 in 0.537s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:30 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a9a580e5-28cf-4194-917f-c5d485af2b39 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-57f90c13-964d-4ab8-8e94-529669bcafed" returned: 0 in 0.492s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a9a580e5-28cf-4194-917f-c5d485af2b39 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-quobyte-57f90c13-964d-4ab8-8e94-529669bcafed" released by "delete_volume" :: held 1.057s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4dfd0006-82cd-446d-a226-115a2c7b43dd {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:30 devstack sudo[91100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4dfd0006-82cd-446d-a226-115a2c7b43dd Apr 15 20:15:30 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-a9a580e5-28cf-4194-917f-c5d485af2b39 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Created reservations ['cfbef6db-52cd-4b53-bd28-cd08ee53f108', '608dbd4e-fc52-46c0-a360-e4ebbb2f9d02', '4757c32f-a0f4-49b0-ba9c-731d1e2a14cc', 'edb6e21c-5521-4f52-8191-a1dd9bf4d167'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a9a580e5-28cf-4194-917f-c5d485af2b39 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a9a580e5-28cf-4194-917f-c5d485af2b39 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-a9a580e5-28cf-4194-917f-c5d485af2b39 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-a9a580e5-28cf-4194-917f-c5d485af2b39 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a9a580e5-28cf-4194-917f-c5d485af2b39 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a9a580e5-28cf-4194-917f-c5d485af2b39 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:30 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:15:30 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e77ea3c6-01f7-45dc-9573-19f59820ea4c tempest-VolumeDependencyTests-116051424 None] Acquiring lock "cinder-88f117bd-573e-467b-a15c-5441a87ca73e-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e77ea3c6-01f7-45dc-9573-19f59820ea4c tempest-VolumeDependencyTests-116051424 None] Lock "cinder-88f117bd-573e-467b-a15c-5441a87ca73e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e77ea3c6-01f7-45dc-9573-19f59820ea4c tempest-VolumeDependencyTests-116051424 None] Acquiring lock "cinder-quobyte-88f117bd-573e-467b-a15c-5441a87ca73e" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e77ea3c6-01f7-45dc-9573-19f59820ea4c tempest-VolumeDependencyTests-116051424 None] Lock "cinder-quobyte-88f117bd-573e-467b-a15c-5441a87ca73e" acquired by "delete_volume" :: waited 0.007s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ae37af-486e-453a-ab29-72bf81a27aab]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:30 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e77ea3c6-01f7-45dc-9573-19f59820ea4c tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:31 devstack sudo[91104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e Apr 15 20:15:31 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:31 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4dfd0006-82cd-446d-a226-115a2c7b43dd" returned: 0 in 0.463s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa45eeb-bc86-4eac-b891-e758d24cc627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dfd0006-82cd-446d-a226-115a2c7b43dd', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a417c37-ebf8-48c3-be0b-1c1598966d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:31 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Volume volume-4dfd0006-82cd-446d-a226-115a2c7b43dd (4dfd0006-82cd-446d-a226-115a2c7b43dd): created successfully Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a417c37-ebf8-48c3-be0b-1c1598966d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Flow 'volume_create_manager' (ee93fc99-ccb4-4ee9-b571-565c9183a34a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:31 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a9a580e5-28cf-4194-917f-c5d485af2b39 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.419s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-a9a580e5-28cf-4194-917f-c5d485af2b39 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:15:31 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-a3bfe9e1-f9ca-427c-96cf-8d928350592c tempest-CinderUnicodeTest-1837374793 None] Created volume successfully. Apr 15 20:15:31 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-a9a580e5-28cf-4194-917f-c5d485af2b39 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Deleted volume successfully. Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a9a580e5-28cf-4194-917f-c5d485af2b39 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-57f90c13-964d-4ab8-8e94-529669bcafed-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:31 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e77ea3c6-01f7-45dc-9573-19f59820ea4c tempest-VolumeDependencyTests-116051424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e" returned: 0 in 0.458s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e77ea3c6-01f7-45dc-9573-19f59820ea4c tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:31 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e Apr 15 20:15:31 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dfc2b99d-212d-4b8a-ac7e-9a949e5c85c1 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "cinder-2a8dd781-3bc2-4cd8-9d48-63a973254830-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dfc2b99d-212d-4b8a-ac7e-9a949e5c85c1 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-2a8dd781-3bc2-4cd8-9d48-63a973254830-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dfc2b99d-212d-4b8a-ac7e-9a949e5c85c1 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "cinder-quobyte-2a8dd781-3bc2-4cd8-9d48-63a973254830" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82989) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Flow 'volume_create_manager' (573eedd8-5eca-45cd-b5af-d9f6b833e5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0add5462-8970-47fc-9de1-4520bba70cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dfc2b99d-212d-4b8a-ac7e-9a949e5c85c1 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-quobyte-2a8dd781-3bc2-4cd8-9d48-63a973254830" acquired by "delete_volume" :: waited 0.047s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3446384-d49a-47df-b931-059c5358ecad]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dfc2b99d-212d-4b8a-ac7e-9a949e5c85c1 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2a8dd781-3bc2-4cd8-9d48-63a973254830 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0add5462-8970-47fc-9de1-4520bba70cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:15:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-428832587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe7a1cc-8fa4-46d0-8417-0e066fac9957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94404f2908ba48bcbde3d9af4557b3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:15:32Z,use_quota=True,user_id='b3f39a3ca4164877812a64ccffc7977b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e004945a-b945-43b5-a23f-71cd406fe333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e004945a-b945-43b5-a23f-71cd406fe333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af504a3-aab0-4e91-9a4f-14964752602a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:31 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af504a3-aab0-4e91-9a4f-14964752602a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fe7a1cc-8fa4-46d0-8417-0e066fac9957', 'volume_name': 'volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098bde1b-543e-4ecf-961d-c7c66ce28dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098bde1b-543e-4ecf-961d-c7c66ce28dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e99ad11-9ccb-485f-9ed5-ea9b4093440e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:31 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Volume 0fe7a1cc-8fa4-46d0-8417-0e066fac9957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957', 'volume_size': 1} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T18:15:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-428832587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe7a1cc-8fa4-46d0-8417-0e066fac9957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94404f2908ba48bcbde3d9af4557b3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T18:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T18:15:32Z,use_quota=True,user_id='b3f39a3ca4164877812a64ccffc7977b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76cdd527-b6e6-4617-9302-6f002aa9d31c),volume_type_id=76cdd527-b6e6-4617-9302-6f002aa9d31c)}" {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Creating volume 0fe7a1cc-8fa4-46d0-8417-0e066fac9957 {{(pid=82989) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Selected osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab as target Quobyte volume. {{(pid=82989) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 20:15:31 devstack cinder-volume[82989]: INFO cinder.volume.drivers.remotefs [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] casted to osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957 1073741824 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e77ea3c6-01f7-45dc-9573-19f59820ea4c tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-88f117bd-573e-467b-a15c-5441a87ca73e" returned: 0 in 0.494s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:31 devstack sudo[91114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2a8dd781-3bc2-4cd8-9d48-63a973254830 Apr 15 20:15:31 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e77ea3c6-01f7-45dc-9573-19f59820ea4c tempest-VolumeDependencyTests-116051424 None] Lock "cinder-quobyte-88f117bd-573e-467b-a15c-5441a87ca73e" released by "delete_volume" :: held 0.979s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:31 devstack sudo[91115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957 1073741824 Apr 15 20:15:31 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-e77ea3c6-01f7-45dc-9573-19f59820ea4c tempest-VolumeDependencyTests-116051424 None] Created reservations ['07ff6b00-240f-4add-8b48-2eeaa0611ea1', '15878ecc-37b8-49ca-af67-4a7bfd85d204', '9bd3e27e-1e07-4e04-bd2d-53d8e58557df', '7dd4fc34-f881-43a7-9025-c34882b76171'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e77ea3c6-01f7-45dc-9573-19f59820ea4c tempest-VolumeDependencyTests-116051424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e77ea3c6-01f7-45dc-9573-19f59820ea4c tempest-VolumeDependencyTests-116051424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e77ea3c6-01f7-45dc-9573-19f59820ea4c tempest-VolumeDependencyTests-116051424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-e77ea3c6-01f7-45dc-9573-19f59820ea4c tempest-VolumeDependencyTests-116051424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-e77ea3c6-01f7-45dc-9573-19f59820ea4c tempest-VolumeDependencyTests-116051424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:31 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e77ea3c6-01f7-45dc-9573-19f59820ea4c tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:32 devstack sudo[91118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:15:32 devstack sudo[91118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:32 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dfc2b99d-212d-4b8a-ac7e-9a949e5c85c1 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2a8dd781-3bc2-4cd8-9d48-63a973254830" returned: 0 in 0.499s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dfc2b99d-212d-4b8a-ac7e-9a949e5c85c1 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2a8dd781-3bc2-4cd8-9d48-63a973254830 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:32 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957 1073741824" returned: 0 in 0.472s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:32 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2a8dd781-3bc2-4cd8-9d48-63a973254830 Apr 15 20:15:32 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:32 devstack sudo[91130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957 Apr 15 20:15:32 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:32 devstack sudo[91118]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-e77ea3c6-01f7-45dc-9573-19f59820ea4c tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.425s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:32 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-e77ea3c6-01f7-45dc-9573-19f59820ea4c tempest-VolumeDependencyTests-116051424 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:15:32 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-e77ea3c6-01f7-45dc-9573-19f59820ea4c tempest-VolumeDependencyTests-116051424 None] Deleted volume successfully. Apr 15 20:15:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-e77ea3c6-01f7-45dc-9573-19f59820ea4c tempest-VolumeDependencyTests-116051424 None] Lock "cinder-88f117bd-573e-467b-a15c-5441a87ca73e-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:32 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dfc2b99d-212d-4b8a-ac7e-9a949e5c85c1 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-2a8dd781-3bc2-4cd8-9d48-63a973254830" returned: 0 in 0.402s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:32 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dfc2b99d-212d-4b8a-ac7e-9a949e5c85c1 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-quobyte-2a8dd781-3bc2-4cd8-9d48-63a973254830" released by "delete_volume" :: held 0.924s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:32 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957" returned: 0 in 0.420s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:32 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'} {{(pid=82989) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 20:15:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:32 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-dfc2b99d-212d-4b8a-ac7e-9a949e5c85c1 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Created reservations ['5ca8300e-5b53-4c9a-aec6-03a2d2ac2f4b', '588343d0-be1d-4d93-a507-978875ad85d0', '80e42a62-f9d6-498a-bb57-d0c47a1b37b7', '349dac2d-eab7-4010-b75d-fc9ad5fed808'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:32 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e99ad11-9ccb-485f-9ed5-ea9b4093440e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957', 'volume_size': 1}' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:32 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eec11af-4704-4395-8e76-aad3d8352757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 20:15:32 devstack cinder-volume[82989]: INFO cinder.volume.flows.manager.create_volume [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Volume volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957 (0fe7a1cc-8fa4-46d0-8417-0e066fac9957): created successfully Apr 15 20:15:32 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eec11af-4704-4395-8e76-aad3d8352757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82989) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 20:15:32 devstack cinder-volume[82989]: DEBUG cinder.volume.manager [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Flow 'volume_create_manager' (573eedd8-5eca-45cd-b5af-d9f6b833e5d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82989) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 20:15:32 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-ee325d2d-5077-4e43-9e36-09627925881c tempest-CinderUnicodeTest-1837374793 None] Created volume successfully. Apr 15 20:15:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dfc2b99d-212d-4b8a-ac7e-9a949e5c85c1 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dfc2b99d-212d-4b8a-ac7e-9a949e5c85c1 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:32 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-dfc2b99d-212d-4b8a-ac7e-9a949e5c85c1 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:32 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-dfc2b99d-212d-4b8a-ac7e-9a949e5c85c1 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-dfc2b99d-212d-4b8a-ac7e-9a949e5c85c1 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:32 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dfc2b99d-212d-4b8a-ac7e-9a949e5c85c1 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:32 devstack sudo[91134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:15:32 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-868967dd-4993-4679-9e1c-f85294d0c7d6 tempest-VolumeDependencyTests-116051424 None] Acquiring lock "cinder-0407c8b3-7c2a-47f8-96aa-2b41f91488b5-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-868967dd-4993-4679-9e1c-f85294d0c7d6 tempest-VolumeDependencyTests-116051424 None] Lock "cinder-0407c8b3-7c2a-47f8-96aa-2b41f91488b5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-868967dd-4993-4679-9e1c-f85294d0c7d6 tempest-VolumeDependencyTests-116051424 None] Acquiring lock "cinder-quobyte-0407c8b3-7c2a-47f8-96aa-2b41f91488b5" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-868967dd-4993-4679-9e1c-f85294d0c7d6 tempest-VolumeDependencyTests-116051424 None] Lock "cinder-quobyte-0407c8b3-7c2a-47f8-96aa-2b41f91488b5" acquired by "delete_volume" :: waited 0.015s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:33 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd66a33-4824-44bf-801a-141518e71d90]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-868967dd-4993-4679-9e1c-f85294d0c7d6 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0407c8b3-7c2a-47f8-96aa-2b41f91488b5 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:33 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0407c8b3-7c2a-47f8-96aa-2b41f91488b5 Apr 15 20:15:33 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:33 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-dfc2b99d-212d-4b8a-ac7e-9a949e5c85c1 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.412s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:33 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-dfc2b99d-212d-4b8a-ac7e-9a949e5c85c1 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:15:33 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-dfc2b99d-212d-4b8a-ac7e-9a949e5c85c1 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Deleted volume successfully. Apr 15 20:15:33 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-dfc2b99d-212d-4b8a-ac7e-9a949e5c85c1 tempest-CreateVolumesFromSourceVolumeTest-1903199333 None] Lock "cinder-2a8dd781-3bc2-4cd8-9d48-63a973254830-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:33 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-868967dd-4993-4679-9e1c-f85294d0c7d6 tempest-VolumeDependencyTests-116051424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0407c8b3-7c2a-47f8-96aa-2b41f91488b5" returned: 0 in 0.462s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:33 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-868967dd-4993-4679-9e1c-f85294d0c7d6 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0407c8b3-7c2a-47f8-96aa-2b41f91488b5 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:33 devstack sudo[91142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0407c8b3-7c2a-47f8-96aa-2b41f91488b5 Apr 15 20:15:33 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:34 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-868967dd-4993-4679-9e1c-f85294d0c7d6 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0407c8b3-7c2a-47f8-96aa-2b41f91488b5" returned: 0 in 0.502s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:34 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-868967dd-4993-4679-9e1c-f85294d0c7d6 tempest-VolumeDependencyTests-116051424 None] Lock "cinder-quobyte-0407c8b3-7c2a-47f8-96aa-2b41f91488b5" released by "delete_volume" :: held 0.999s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:34 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-868967dd-4993-4679-9e1c-f85294d0c7d6 tempest-VolumeDependencyTests-116051424 None] Created reservations ['bf58ecee-ee45-4af3-91f4-4369d9a1d751', 'af38dc37-a812-4fe1-ab8d-13a1f23bc024', 'c91d5431-1c49-468c-84b7-5a4a68725e60', '6dbe8dfc-e411-4d0c-9d44-ea182fb2be40'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-11f068ed-b298-4829-bf8e-ba7b8b8c1178 tempest-CinderUnicodeTest-1837374793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-11f068ed-b298-4829-bf8e-ba7b8b8c1178 tempest-CinderUnicodeTest-1837374793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-11f068ed-b298-4829-bf8e-ba7b8b8c1178 tempest-CinderUnicodeTest-1837374793 None] Creating offline snapshot 77425a12-6e35-44ab-88db-cbed6184c68d of volume 0fe7a1cc-8fa4-46d0-8417-0e066fac9957 {{(pid=82989) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 20:15:34 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4189bcc-018e-46d9-b86a-680ad684ac18]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-11f068ed-b298-4829-bf8e-ba7b8b8c1178 tempest-CinderUnicodeTest-1837374793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-868967dd-4993-4679-9e1c-f85294d0c7d6 tempest-VolumeDependencyTests-116051424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-868967dd-4993-4679-9e1c-f85294d0c7d6 tempest-VolumeDependencyTests-116051424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-868967dd-4993-4679-9e1c-f85294d0c7d6 tempest-VolumeDependencyTests-116051424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:34 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-868967dd-4993-4679-9e1c-f85294d0c7d6 tempest-VolumeDependencyTests-116051424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-868967dd-4993-4679-9e1c-f85294d0c7d6 tempest-VolumeDependencyTests-116051424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-868967dd-4993-4679-9e1c-f85294d0c7d6 tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:34 devstack sudo[91147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:15:34 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:34 devstack sudo[91146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957 Apr 15 20:15:34 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:34 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-868967dd-4993-4679-9e1c-f85294d0c7d6 tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.445s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:34 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-868967dd-4993-4679-9e1c-f85294d0c7d6 tempest-VolumeDependencyTests-116051424 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:15:34 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-868967dd-4993-4679-9e1c-f85294d0c7d6 tempest-VolumeDependencyTests-116051424 None] Deleted volume successfully. Apr 15 20:15:34 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-11f068ed-b298-4829-bf8e-ba7b8b8c1178 tempest-CinderUnicodeTest-1837374793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957" returned: 0 in 0.544s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:34 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-11f068ed-b298-4829-bf8e-ba7b8b8c1178 tempest-CinderUnicodeTest-1837374793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.77425a12-6e35-44ab-88db-cbed6184c68d 1G {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:34 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-868967dd-4993-4679-9e1c-f85294d0c7d6 tempest-VolumeDependencyTests-116051424 None] Lock "cinder-0407c8b3-7c2a-47f8-96aa-2b41f91488b5-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:34 devstack sudo[91154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.77425a12-6e35-44ab-88db-cbed6184c68d 1G Apr 15 20:15:34 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:35 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-11f068ed-b298-4829-bf8e-ba7b8b8c1178 tempest-CinderUnicodeTest-1837374793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.77425a12-6e35-44ab-88db-cbed6184c68d 1G" returned: 0 in 0.512s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-11f068ed-b298-4829-bf8e-ba7b8b8c1178 tempest-CinderUnicodeTest-1837374793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.77425a12-6e35-44ab-88db-cbed6184c68d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:35 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-fe38b569-5ab9-4f2b-b4cf-c79e8524bb0a tempest-VolumeDependencyTests-116051424 None] Acquiring lock "cinder-5d626a61-46d0-41f7-bb51-4602c062ad9f-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:35 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.77425a12-6e35-44ab-88db-cbed6184c68d Apr 15 20:15:35 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:35 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-fe38b569-5ab9-4f2b-b4cf-c79e8524bb0a tempest-VolumeDependencyTests-116051424 None] Lock "cinder-5d626a61-46d0-41f7-bb51-4602c062ad9f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:35 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-fe38b569-5ab9-4f2b-b4cf-c79e8524bb0a tempest-VolumeDependencyTests-116051424 None] Acquiring lock "cinder-quobyte-5d626a61-46d0-41f7-bb51-4602c062ad9f" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:35 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-fe38b569-5ab9-4f2b-b4cf-c79e8524bb0a tempest-VolumeDependencyTests-116051424 None] Lock "cinder-quobyte-5d626a61-46d0-41f7-bb51-4602c062ad9f" acquired by "delete_volume" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:35 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd274e4-1f93-4f1e-a0c8-890d5bdc0493]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fe38b569-5ab9-4f2b-b4cf-c79e8524bb0a tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d626a61-46d0-41f7-bb51-4602c062ad9f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:35 devstack sudo[91161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d626a61-46d0-41f7-bb51-4602c062ad9f Apr 15 20:15:35 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:35 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-11f068ed-b298-4829-bf8e-ba7b8b8c1178 tempest-CinderUnicodeTest-1837374793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957 -F qcow2 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.77425a12-6e35-44ab-88db-cbed6184c68d" returned: 0 in 0.451s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:35 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-11f068ed-b298-4829-bf8e-ba7b8b8c1178 tempest-CinderUnicodeTest-1837374793 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.77425a12-6e35-44ab-88db-cbed6184c68d is being set with open permissions: ugo+rw Apr 15 20:15:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-11f068ed-b298-4829-bf8e-ba7b8b8c1178 tempest-CinderUnicodeTest-1837374793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.77425a12-6e35-44ab-88db-cbed6184c68d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:35 devstack sudo[91166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.77425a12-6e35-44ab-88db-cbed6184c68d Apr 15 20:15:35 devstack sudo[91166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:35 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fe38b569-5ab9-4f2b-b4cf-c79e8524bb0a tempest-VolumeDependencyTests-116051424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d626a61-46d0-41f7-bb51-4602c062ad9f" returned: 0 in 0.491s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:35 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fe38b569-5ab9-4f2b-b4cf-c79e8524bb0a tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d626a61-46d0-41f7-bb51-4602c062ad9f {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:35 devstack sudo[91171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d626a61-46d0-41f7-bb51-4602c062ad9f Apr 15 20:15:35 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:36 devstack sudo[91166]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-11f068ed-b298-4829-bf8e-ba7b8b8c1178 tempest-CinderUnicodeTest-1837374793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.77425a12-6e35-44ab-88db-cbed6184c68d" returned: 0 in 0.395s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-11f068ed-b298-4829-bf8e-ba7b8b8c1178 tempest-CinderUnicodeTest-1837374793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:36 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.info Apr 15 20:15:36 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:36 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fe38b569-5ab9-4f2b-b4cf-c79e8524bb0a tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-5d626a61-46d0-41f7-bb51-4602c062ad9f" returned: 0 in 0.398s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:36 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-fe38b569-5ab9-4f2b-b4cf-c79e8524bb0a tempest-VolumeDependencyTests-116051424 None] Lock "cinder-quobyte-5d626a61-46d0-41f7-bb51-4602c062ad9f" released by "delete_volume" :: held 0.924s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:36 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-fe38b569-5ab9-4f2b-b4cf-c79e8524bb0a tempest-VolumeDependencyTests-116051424 None] Created reservations ['17ef7d59-883e-4625-908a-fd87670068a9', '0207b873-efa4-4d49-a9df-f7c383127234', 'b5bc5a41-a1ae-4a38-adba-234720303015', '4be63460-02d1-4bf6-bedf-e2a65de80d65'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fe38b569-5ab9-4f2b-b4cf-c79e8524bb0a tempest-VolumeDependencyTests-116051424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fe38b569-5ab9-4f2b-b4cf-c79e8524bb0a tempest-VolumeDependencyTests-116051424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:36 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-fe38b569-5ab9-4f2b-b4cf-c79e8524bb0a tempest-VolumeDependencyTests-116051424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:36 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-fe38b569-5ab9-4f2b-b4cf-c79e8524bb0a tempest-VolumeDependencyTests-116051424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-fe38b569-5ab9-4f2b-b4cf-c79e8524bb0a tempest-VolumeDependencyTests-116051424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fe38b569-5ab9-4f2b-b4cf-c79e8524bb0a tempest-VolumeDependencyTests-116051424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:36 devstack sudo[91177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:15:36 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:36 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-11f068ed-b298-4829-bf8e-ba7b8b8c1178 tempest-CinderUnicodeTest-1837374793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.info" returned: 0 in 0.450s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:36 devstack cinder-volume[82989]: WARNING cinder.volume.drivers.remotefs [None req-11f068ed-b298-4829-bf8e-ba7b8b8c1178 tempest-CinderUnicodeTest-1837374793 None] /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.info is being set with open permissions: ugo+rw Apr 15 20:15:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-11f068ed-b298-4829-bf8e-ba7b8b8c1178 tempest-CinderUnicodeTest-1837374793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.info {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:36 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.info Apr 15 20:15:36 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:36 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:36 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-fe38b569-5ab9-4f2b-b4cf-c79e8524bb0a tempest-VolumeDependencyTests-116051424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.439s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:36 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-fe38b569-5ab9-4f2b-b4cf-c79e8524bb0a tempest-VolumeDependencyTests-116051424 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:15:36 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-fe38b569-5ab9-4f2b-b4cf-c79e8524bb0a tempest-VolumeDependencyTests-116051424 None] Deleted volume successfully. Apr 15 20:15:36 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-fe38b569-5ab9-4f2b-b4cf-c79e8524bb0a tempest-VolumeDependencyTests-116051424 None] Lock "cinder-5d626a61-46d0-41f7-bb51-4602c062ad9f-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:37 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-11f068ed-b298-4829-bf8e-ba7b8b8c1178 tempest-CinderUnicodeTest-1837374793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.info" returned: 0 in 0.462s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-11f068ed-b298-4829-bf8e-ba7b8b8c1178 tempest-CinderUnicodeTest-1837374793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.869s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:37 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-11f068ed-b298-4829-bf8e-ba7b8b8c1178 tempest-CinderUnicodeTest-1837374793 None] Create snapshot completed successfully Apr 15 20:15:37 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-93d409bf-4711-43cb-94c3-a111765c086f tempest-CinderUnicodeTest-1837374793 None] Acquiring lock "cinder-77425a12-6e35-44ab-88db-cbed6184c68d-delete_snapshot" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:37 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-93d409bf-4711-43cb-94c3-a111765c086f tempest-CinderUnicodeTest-1837374793 None] Lock "cinder-77425a12-6e35-44ab-88db-cbed6184c68d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:37 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-93d409bf-4711-43cb-94c3-a111765c086f tempest-CinderUnicodeTest-1837374793 None] Acquiring lock "cinder-quobyte-0fe7a1cc-8fa4-46d0-8417-0e066fac9957" by "delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:37 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-93d409bf-4711-43cb-94c3-a111765c086f tempest-CinderUnicodeTest-1837374793 None] Lock "cinder-quobyte-0fe7a1cc-8fa4-46d0-8417-0e066fac9957" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:37 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-93d409bf-4711-43cb-94c3-a111765c086f tempest-CinderUnicodeTest-1837374793 None] Acquiring lock "cinder-quobyte-77425a12-6e35-44ab-88db-cbed6184c68d" by "_delete_snapshot" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:37 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-93d409bf-4711-43cb-94c3-a111765c086f tempest-CinderUnicodeTest-1837374793 None] Lock "cinder-quobyte-77425a12-6e35-44ab-88db-cbed6184c68d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:37 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-93d409bf-4711-43cb-94c3-a111765c086f tempest-CinderUnicodeTest-1837374793 None] Deleting offline snapshot 77425a12-6e35-44ab-88db-cbed6184c68d of volume 0fe7a1cc-8fa4-46d0-8417-0e066fac9957 {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 20:15:37 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-93d409bf-4711-43cb-94c3-a111765c086f tempest-CinderUnicodeTest-1837374793 None] snapshot_file for this snap is: volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.77425a12-6e35-44ab-88db-cbed6184c68d {{(pid=82989) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 20:15:37 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e5eccc-995c-45ac-8312-7368ebd149ba]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-93d409bf-4711-43cb-94c3-a111765c086f tempest-CinderUnicodeTest-1837374793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.77425a12-6e35-44ab-88db-cbed6184c68d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:37 devstack sudo[91184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.77425a12-6e35-44ab-88db-cbed6184c68d Apr 15 20:15:37 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:37 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-93d409bf-4711-43cb-94c3-a111765c086f tempest-CinderUnicodeTest-1837374793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.77425a12-6e35-44ab-88db-cbed6184c68d" returned: 0 in 0.464s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:37 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.remotefs [None req-93d409bf-4711-43cb-94c3-a111765c086f tempest-CinderUnicodeTest-1837374793 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82989) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 20:15:37 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1735b9-7a9c-44e5-b168-307329d072bf]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:37 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-93d409bf-4711-43cb-94c3-a111765c086f tempest-CinderUnicodeTest-1837374793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:37 devstack sudo[91189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957 Apr 15 20:15:37 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:38 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-93d409bf-4711-43cb-94c3-a111765c086f tempest-CinderUnicodeTest-1837374793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957" returned: 0 in 0.446s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-93d409bf-4711-43cb-94c3-a111765c086f tempest-CinderUnicodeTest-1837374793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.77425a12-6e35-44ab-88db-cbed6184c68d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:38 devstack sudo[91194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.77425a12-6e35-44ab-88db-cbed6184c68d Apr 15 20:15:38 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:38 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-93d409bf-4711-43cb-94c3-a111765c086f tempest-CinderUnicodeTest-1837374793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.77425a12-6e35-44ab-88db-cbed6184c68d" returned: 0 in 0.424s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:38 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-93d409bf-4711-43cb-94c3-a111765c086f tempest-CinderUnicodeTest-1837374793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.77425a12-6e35-44ab-88db-cbed6184c68d {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:38 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.77425a12-6e35-44ab-88db-cbed6184c68d Apr 15 20:15:38 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:39 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-93d409bf-4711-43cb-94c3-a111765c086f tempest-CinderUnicodeTest-1837374793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957.77425a12-6e35-44ab-88db-cbed6184c68d" returned: 0 in 0.385s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-93d409bf-4711-43cb-94c3-a111765c086f tempest-CinderUnicodeTest-1837374793 None] Lock "cinder-quobyte-77425a12-6e35-44ab-88db-cbed6184c68d" released by "_delete_snapshot" :: held 1.772s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-93d409bf-4711-43cb-94c3-a111765c086f tempest-CinderUnicodeTest-1837374793 None] Lock "cinder-quobyte-0fe7a1cc-8fa4-46d0-8417-0e066fac9957" released by "delete_snapshot" :: held 1.789s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:39 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-93d409bf-4711-43cb-94c3-a111765c086f tempest-CinderUnicodeTest-1837374793 None] Created reservations ['5f29bfc7-9411-4279-bd9c-78f8d048e183', '5212615f-0e85-4dcc-a943-a1e89fdd6975', '1d6c4aa5-1040-46d3-b9b1-57253d2da006', '69dd5e09-ce15-4cf5-8422-f2c1535140d5'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:39 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-93d409bf-4711-43cb-94c3-a111765c086f tempest-CinderUnicodeTest-1837374793 None] Delete snapshot completed successfully. Apr 15 20:15:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-93d409bf-4711-43cb-94c3-a111765c086f tempest-CinderUnicodeTest-1837374793 None] Lock "cinder-77425a12-6e35-44ab-88db-cbed6184c68d-delete_snapshot" released by "delete_snapshot" :: held 1.867s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-39dc23d5-37b0-4fd7-8aa5-c258c4fadf13 tempest-CinderUnicodeTest-1837374793 None] Acquiring lock "cinder-0fe7a1cc-8fa4-46d0-8417-0e066fac9957-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-39dc23d5-37b0-4fd7-8aa5-c258c4fadf13 tempest-CinderUnicodeTest-1837374793 None] Lock "cinder-0fe7a1cc-8fa4-46d0-8417-0e066fac9957-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-39dc23d5-37b0-4fd7-8aa5-c258c4fadf13 tempest-CinderUnicodeTest-1837374793 None] Acquiring lock "cinder-quobyte-0fe7a1cc-8fa4-46d0-8417-0e066fac9957" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:39 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-39dc23d5-37b0-4fd7-8aa5-c258c4fadf13 tempest-CinderUnicodeTest-1837374793 None] Lock "cinder-quobyte-0fe7a1cc-8fa4-46d0-8417-0e066fac9957" acquired by "delete_volume" :: waited 0.009s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:39 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[571f2206-caca-4936-8d60-9195503a22c0]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-39dc23d5-37b0-4fd7-8aa5-c258c4fadf13 tempest-CinderUnicodeTest-1837374793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:39 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957 Apr 15 20:15:39 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:39 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-39dc23d5-37b0-4fd7-8aa5-c258c4fadf13 tempest-CinderUnicodeTest-1837374793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957" returned: 0 in 0.445s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:39 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-39dc23d5-37b0-4fd7-8aa5-c258c4fadf13 tempest-CinderUnicodeTest-1837374793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957 {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:39 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957 Apr 15 20:15:39 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:40 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-39dc23d5-37b0-4fd7-8aa5-c258c4fadf13 tempest-CinderUnicodeTest-1837374793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-0fe7a1cc-8fa4-46d0-8417-0e066fac9957" returned: 0 in 0.385s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:40 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-39dc23d5-37b0-4fd7-8aa5-c258c4fadf13 tempest-CinderUnicodeTest-1837374793 None] Lock "cinder-quobyte-0fe7a1cc-8fa4-46d0-8417-0e066fac9957" released by "delete_volume" :: held 0.857s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:40 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-39dc23d5-37b0-4fd7-8aa5-c258c4fadf13 tempest-CinderUnicodeTest-1837374793 None] Created reservations ['82d8169b-a77f-49b9-b8da-4f6d8947b1cc', 'f72eb3c6-a882-4023-9ef3-5324e237e6c8', 'c0071212-fdc5-4101-b7ce-2eff297f91aa', '3541bfd3-451d-4066-a1b1-af1b8f817257'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-39dc23d5-37b0-4fd7-8aa5-c258c4fadf13 tempest-CinderUnicodeTest-1837374793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-39dc23d5-37b0-4fd7-8aa5-c258c4fadf13 tempest-CinderUnicodeTest-1837374793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-39dc23d5-37b0-4fd7-8aa5-c258c4fadf13 tempest-CinderUnicodeTest-1837374793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:40 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-39dc23d5-37b0-4fd7-8aa5-c258c4fadf13 tempest-CinderUnicodeTest-1837374793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-39dc23d5-37b0-4fd7-8aa5-c258c4fadf13 tempest-CinderUnicodeTest-1837374793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-39dc23d5-37b0-4fd7-8aa5-c258c4fadf13 tempest-CinderUnicodeTest-1837374793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:40 devstack sudo[91210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:15:40 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:40 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a5ce7f4c-05a0-44b1-96d7-432d6b74f126 tempest-CinderUnicodeTest-1837374793 None] Acquiring lock "cinder-4dfd0006-82cd-446d-a226-115a2c7b43dd-delete_volume" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:40 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a5ce7f4c-05a0-44b1-96d7-432d6b74f126 tempest-CinderUnicodeTest-1837374793 None] Lock "cinder-4dfd0006-82cd-446d-a226-115a2c7b43dd-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:40 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a5ce7f4c-05a0-44b1-96d7-432d6b74f126 tempest-CinderUnicodeTest-1837374793 None] Acquiring lock "cinder-quobyte-4dfd0006-82cd-446d-a226-115a2c7b43dd" by "delete_volume" {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 20:15:40 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a5ce7f4c-05a0-44b1-96d7-432d6b74f126 tempest-CinderUnicodeTest-1837374793 None] Lock "cinder-quobyte-4dfd0006-82cd-446d-a226-115a2c7b43dd" acquired by "delete_volume" :: waited 0.018s {{(pid=82989) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 20:15:40 devstack cinder-volume[82989]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd53d87-c7ed-4b07-ada6-3515bc2e4604]: (4, 'qcow2') {{(pid=83770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 20:15:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a5ce7f4c-05a0-44b1-96d7-432d6b74f126 tempest-CinderUnicodeTest-1837374793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4dfd0006-82cd-446d-a226-115a2c7b43dd {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:40 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4dfd0006-82cd-446d-a226-115a2c7b43dd Apr 15 20:15:40 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:40 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:40 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-39dc23d5-37b0-4fd7-8aa5-c258c4fadf13 tempest-CinderUnicodeTest-1837374793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.410s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:40 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-39dc23d5-37b0-4fd7-8aa5-c258c4fadf13 tempest-CinderUnicodeTest-1837374793 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:15:40 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-39dc23d5-37b0-4fd7-8aa5-c258c4fadf13 tempest-CinderUnicodeTest-1837374793 None] Deleted volume successfully. Apr 15 20:15:40 devstack cinder-volume[82989]: DEBUG dbcounter [-] [82989] Writing DB stats cinder:SELECT=217,cinder:UPDATE=297,cinder:DELETE=31,cinder:INSERT=69 {{(pid=82989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 20:15:40 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-39dc23d5-37b0-4fd7-8aa5-c258c4fadf13 tempest-CinderUnicodeTest-1837374793 None] Lock "cinder-0fe7a1cc-8fa4-46d0-8417-0e066fac9957-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:41 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a5ce7f4c-05a0-44b1-96d7-432d6b74f126 tempest-CinderUnicodeTest-1837374793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4dfd0006-82cd-446d-a226-115a2c7b43dd" returned: 0 in 0.449s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a5ce7f4c-05a0-44b1-96d7-432d6b74f126 tempest-CinderUnicodeTest-1837374793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4dfd0006-82cd-446d-a226-115a2c7b43dd {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:41 devstack sudo[91218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4dfd0006-82cd-446d-a226-115a2c7b43dd Apr 15 20:15:41 devstack sudo[91218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:41 devstack sudo[91218]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a5ce7f4c-05a0-44b1-96d7-432d6b74f126 tempest-CinderUnicodeTest-1837374793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df/volume-4dfd0006-82cd-446d-a226-115a2c7b43dd" returned: 0 in 0.391s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:41 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a5ce7f4c-05a0-44b1-96d7-432d6b74f126 tempest-CinderUnicodeTest-1837374793 None] Lock "cinder-quobyte-4dfd0006-82cd-446d-a226-115a2c7b43dd" released by "delete_volume" :: held 0.861s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 20:15:41 devstack cinder-volume[82989]: DEBUG cinder.quota [None req-a5ce7f4c-05a0-44b1-96d7-432d6b74f126 tempest-CinderUnicodeTest-1837374793 None] Created reservations ['a04a83eb-5aa4-42f7-80aa-7a8f3d7ec122', '1fdc7752-52d3-47e8-a54d-33fdc47d5787', '36e58783-6072-4ba9-b1fc-2c8110d84516', '5c5d47c7-adf9-4381-a4c6-128a7b2629be'] {{(pid=82989) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 20:15:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a5ce7f4c-05a0-44b1-96d7-432d6b74f126 tempest-CinderUnicodeTest-1837374793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 20:15:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a5ce7f4c-05a0-44b1-96d7-432d6b74f126 tempest-CinderUnicodeTest-1837374793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 20:15:41 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-a5ce7f4c-05a0-44b1-96d7-432d6b74f126 tempest-CinderUnicodeTest-1837374793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab': None} {{(pid=82989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 20:15:41 devstack cinder-volume[82989]: DEBUG cinder.volume.drivers.quobyte [None req-a5ce7f4c-05a0-44b1-96d7-432d6b74f126 tempest-CinderUnicodeTest-1837374793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dc442b2-b1d1-436e-8c31-d1b783f010ab'] {{(pid=82989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 20:15:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.lockutils [None req-a5ce7f4c-05a0-44b1-96d7-432d6b74f126 tempest-CinderUnicodeTest-1837374793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82989) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 20:15:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a5ce7f4c-05a0-44b1-96d7-432d6b74f126 tempest-CinderUnicodeTest-1837374793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 20:15:41 devstack sudo[91221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df Apr 15 20:15:41 devstack sudo[91221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 20:15:41 devstack sudo[91221]: pam_unix(sudo:session): session closed for user root Apr 15 20:15:41 devstack cinder-volume[82989]: DEBUG oslo_concurrency.processutils [None req-a5ce7f4c-05a0-44b1-96d7-432d6b74f126 tempest-CinderUnicodeTest-1837374793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0c426b12f632317788e37a1f5d092df" returned: 0 in 0.417s {{(pid=82989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 20:15:41 devstack cinder-volume[82989]: DEBUG cinder.manager [None req-a5ce7f4c-05a0-44b1-96d7-432d6b74f126 tempest-CinderUnicodeTest-1837374793 None] Notifying Schedulers of capabilities ... {{(pid=82989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 20:15:41 devstack cinder-volume[82989]: INFO cinder.volume.manager [None req-a5ce7f4c-05a0-44b1-96d7-432d6b74f126 tempest-CinderUnicodeTest-1837374793 None] Deleted volume successfully. Apr 15 20:15:41 devstack cinder-volume[82989]: DEBUG cinder.coordination [None req-a5ce7f4c-05a0-44b1-96d7-432d6b74f126 tempest-CinderUnicodeTest-1837374793 None] Lock "cinder-4dfd0006-82cd-446d-a226-115a2c7b43dd-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=82989) __release /opt/stack/cinder/cinder/coordination.py:152}}